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Abstract 

This  document  is  MAT  HEMATIC  A' s  final  report  under  contract 
N00014-70-C-0307.  It  describes  the  results  of  our  mathematical 
research  into  destroyer -submarine  encounters.  The  work  concen¬ 
trated  principally  on  a  submarine's  approach  and  penetration  into  a 
destroyer  screen.  In  our  r  iport,  a  statistical  model  is  developed, 
the  utility  of  such  a  model  for  analyzing  sea  exercises  demonstrated, 
and  the  relative  success  of  penetration  evaluated  for  different  patrol 
patterns,  speeds,  barrier  geometries  and  so  forth. 

The  approach  and  penetration  model  uses  an  instantaneous  sonar 
detection  rate  or  db.-min.  model.  Its  advantages  over  the  so-called 
cookie-cutter  detection  model  are  demonstrated.  The  results  of  an 
investigation  comparing  the  db.-min,  model  with  another  detection 
model  are  also  discussed.  Procedures  for  fitting  the  instantaneous 
detection  rate  model  to  observed  exercise  data  are  provided. 

Positioning  models  were  also  developed  and  are  described.  As 
a  submarine  approaches  a  barrier  it  is  faced  with  a  choice  between 
delaying  penetration  to  possibly  gain  a  more  favorable  position  or 
initiating  penetration  to  reduce  exposure  and  risk  of  detection.  Where 
the  submarine  receives  information  about  destroyer  locations,  this 
report  models  the  situation  as  a  stopping  rule  problem.  Where  it 
does  not,  the  situation  is  modeled  with  dynamic  programming. 

Finally,  results  are  obtained  about  the  distribution  of  a  transit 
point  into  a  barrier  under  specific  assumptions  about  the  destroyer's 
patrol  pattern  and  the  submarine's  choice  of  a  transit  point.  It  is 
shown  that  the  distribution  is  triangular  or  approximately  triangular 
in  each  gap  between  the  destroyers  of  the  screen. 
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During  the  course  of  this  research  several  aspects  of  destroyer - 
submarine  encounters  have  been  investigated.  The  primary  work  has 
been  concentrated  on  three  vertically  integrated  models  as  illustrated 
in  the  following  figure: 


Figure  A-1.  Encounter  Models  i 

I 

At  the  lowest  level  is  an  instantaneous  probability  detection 
model.  During  the  time  that  a  submarine  is  in  the  vicinity  of  a  des¬ 
troyer  or  other  sonar  receptor,  there  are  continuous  transmissions 
of  sound  from  the  submarine.  The  task  of  the  sonar  equipment  and 
of  the  sonar  operators  is  to  separate  submarine  sound  from  other 
noise.  The  length  of  exposure  at  various  noise  levels  determines  the 
probability  of  detection.  Since  the  noise  level  is  a  continuously  vary¬ 
ing  phenomenon,  it  is  necessary  to  use  certain  concepts  of  calculus. 
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Let  us  define  N(t)  as  the  signal  excess  over  background  noise 

at  time  t  and  let  us  define  the  instantaneous  detection  rate  \{z)  such 

that  in  a  short  interval  of  time  from  t  to  t  +At.  the  probability  of 

detection  is  approximately  X{t)At.  The  value  of  X(t)  is  defined 

exactly  by  letting  At  approach  zero.  The  work  on  this  project  has 

2 

shown  that  X(t)  may  be  approximated  by  A*  N(t)  +  B*  N  (t).  Since  N(t) 
can  be  estimated  from  data  about  equipment  and  sound  propagation, 
the  parameters  A  and  B  can  also  be  estimated. 

It  is  thus  possible  in  an  encounter  in  which  the  relative  tracks 
of  a  submarine  and  a  destroyer  are  known  to  determine  the  probability 
of  detection.  This  method  is  much  preferred  to  a  "cookie  cutter" 
model  V  henever  it  can  be  used.  In  this  latter  form,  the  outcome 
simply  hinges  on  whether  the  closest  point  of  approach  is  within  the 
circular  area  of  the  "cookie  cutter;"  thus,  no  probability  is  associated 
with  the  transit. 

Various  approaches  to  instantaneous  detection  models  have  been 
taken  but  ours  appears  to  be  the  first  to  form  a  relationship  between 
signal  excess  and  instantaneous  detection  rate  based  on  actual  encoun¬ 
ters.  Recently  a  similar  model*,  although  without  the  quadratic  term 
suggested  above,  has  been  used  in  analyzing  SHAREM  exercises. 

The  second  model  in  the  series  represents  the  situation  in  which 
a  submarine  is  attempting  to  penetrate  a  convoy  screen  or  barrier 
patrol  of  destroyers.  The  patrol  patterns  of  the  destroyers  and  the 
approach-penetration  pattern  of  the  submarine  are  simulated  under 

*  COMDESDEVGRU2,  ltrser076,  3  August  1970,  "Analysis  of  Data 
on  Destroyer  ASW  Screening  Mission." 


various  assumptions.  Because  of  the  inherent  randomness  of  the 
ship  tracks,  several  runs  are  simulated  for  any  one  case  and  for 
each  run  the  probability  of  detection  is  determined  with  the  first 
model.  The  average  of  these  detection  probabilities  forms  the  en¬ 
counter  probability  of  detection  under  the  specified  assumptions. 

The  following  assumptions  are  made  in  all  cases.  The  destroy¬ 
ers  (generally  three  are  simulated)  are  all  actively  pinging  and  the 
submarine  is  thus  able  to  hear  the  destroyer  before  the  destroyer 
can  hear  the  submarine.  In  addition,  the  submarine  can  estimate  the 
bearing,  range,  and  course  of  the  destroyer  during  this  period. 

The  following  assumptions  may  be  varied  from  case  to  case. 
Passive  sonars  may  be  spread  uniformly  over  the  barrier;  if  they 
are,  the  ratio  of  passive  to  active  sonars  may  be  specified. 


The  destroyer's  patrol  pattern  may  be  chosen  from  the  following 
three  patterns. 

(a)  Back  and  forth  patrol.  The  destroyer  patrols  between 
the  two  end-points  of  the  zonal  mid-line  (E-W).  The 
destroyer  may  reverse  direction  during  a  leg,  as 
determined  by  drawing  a  random  number.  The  fre-  jsj 

quency  of  such  reversals  may  be  specified.  A 
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(b)  Random  segments  in  random  directions  within  the  zone 
The  destroyer  performs  straight  line  segments  within 
the  zone  as  follows: 

WIDTH 


Figure  A-3.  Random  Patrol 


At  the  start  of  each  leg  a  direction  is  chosen  randomly 
within  +  45%  of  the  midline.  With  some  probability  the 
destroyer  may  reverse  course  at  the  start  of  each  leg; 
otherwise  it  continues  until  a  boundary  is  reached, 

(c)  Zig-zag  path  at  45^  to  E-W  line.  The  destroyer  moves 
back  and  forth  along  a  broken  line  with  each  leg  at  a  45*^ 
angle  with  the  midline. 


Figure  A-4.  Zig-zag  Patrol 

With  some  probability,  the  destroyer  may  reverse  course 
at  the  start  of  each  leg. 

The  submarine's  approach  and  penetration  pattern  is  as  follows. 
The  submarine  approaches  from  the  South  and  continues  its  advance 
until  it  detects  a  destroyer.  If  none  is  detected,  the  submarine  passes 
straight  through.  Otherwise  upon  hearing  the  destroyer,  it  may,  de¬ 
pending  on  an  assumed  boldness  factor,  attempt  a  direct  penetration 
or  side-step  and  attempt  to  evade  the  destroyer  by  penetrating  through 
a  gap.  In  certain  situations  it  may  be  assumed  that  the  submarine  will 
attempt  an  end  run  around  the  screen. 

The  use  of  this  model  produces  tables  of  detection  probabilities 
under  the  varied  asumptions.  The  following  figure  shows  a  typical 
array  of  results  for  a  few  of  the  different  assumptions.  A  complete 
table  might  have  twenty  or  thirty  entries  in  each  direction. 
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Figure  A- 5.  Probabilities  of  Successful  Penetration 


These  figures  are  useful  in  their  own  right,  particularly  in 
reviewing  specific  encounters,  either  past  or  planned.  However, 
the  reader  may  recognize  that  the  assumptions  for  each  side  really 
represent  strategies  in  a  game  theoretic  sense.  Thus,  the  table  of 
results  can  be  regarded  as  representing  a  game  matrix.  In  the  par- 
ticvilar  case  presented  above  the  submarine's  strategy  of  proceeding 
at  10  knots  and  being  neither  particularly  bold  nor  cautious  dominates 
its  other  strategies.  Consequently  the  game  is  easily  solved  and  the 
destroyer  should  employ  a  zig-zag  patrol  in  response  to  tlje  sub¬ 
marine's  actions. 

In  general,  to  distinguish  the  optimal  strategies,  the  game 
matrix  may  be  solvcid  using  linear  programming  techniques. 
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Specific  issues  have  arisen  in  the  •'^nrse  of  the  research  that 
have  received  special  investigation.  These  additional  topics  and 
their  relationship  to  the  primary  models  described  above  are  illus¬ 
trated  in  the  following  figure: 


Game  Theoretic  Model 
of  Encounter  Tactics 


Stopping  Rule  Analysis 
of  Barrier  Penetration 


Distribution  of  the 
Gap  Transit  Point 


Statistical  Study  of 

Destroyer-Submarine  Encounters ; 


Fitting  Detection  Models 

Instantaneous  Probability 

to  Observed  Data 

Detection  Model 

Figure  A-6.  Encounter  and  Related  Models 

The  purpose  of  the  stopping  rule  analysis  of  barrier  penetration 
is  to  determine  the  optimal  behavior  for  a  submarine  waiting  in  a 
"holding  pattern"  to  penetrate  a  destroyer  barrier  or  screen.  At  some 
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risk  it  can  wait  in  an  area  outside  of  the  detection  range  but  not  close 
enough  to  obtain  information  about  the  destroyers'  positions  and 
patrol  patterns.  The  question  arises  as  to  the  circumstances  in 
which  it  becomes  more  advantageous  to  attempt  penetration  than  to 
gather  more  information  or  wait  for  a  potentially  better  opportunity. 
Satisfactory  results  have  been  obtained  using  the  theory  of  stopping 
rule  analysis;  all  of  the  information  available  to  the  submarine  is 
employed  to  find  its  optimal  penetration  policy. 

The  probability  distribution  of  the  barrier  transit  point  is  a 
collateral  result  obtained  during  the  study.  While  not  bearing  directly 
on  the  other  models,  it  is  of  interest  in  its  own  right;  a  paper  on  the 
subject  has  been  prepared  and  submitted  to  the  Naval  Logistics 
Research  Quarterly.  In  the  situation  analyzed,  destroyers  patrol 
segments  of  a  barrier  or  screen  which  may  or  may  not  overlap.  The 
submarine  is  given  a  chance  to  pick  a  gap  between  the  destroyers  at 
an  arbitrary  point  in  time.  The  resulting  distribution  of  the  location 
of  the  chosen  transit  point  is  determined.  If  two  destroyers  are  present, 
a  triangular  distribution  results;  if  three  destroyers,  an  irregular 
distribution  results  which  nevertheless  resembles  a  triangular  distri¬ 
bution  in  each  gap  area. 

The  purpose  of  developing  methods  for  fitting  the  instantaneous 
probability  detection  model  to  observed  exercise  data  is  to  guarantee 
that  the  detection  model  can  truly  represent  the  real  world.  As 

2 

previously  described,  the  detection  rate  X(fc)  is  given  by  A*  N{t)+B*  N  (t) 
where  N{t)  is  the  signal  excess  and  A  and  B  are  parameters.  We  have 
developed  a  maximum  likelihood  estimation  procedure  for  determing  A  and  B 
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and  an  approximate  procedure  for  finding  a  confidence  region  on  A  and 
B  simultaneously.  A  test  for  consistency  is  also  developed  which 
makes  it  possible  to  test  whether  the  instantaneous  detection  model 
adequately  explains  observed  variations  in  first  detection  time. 

The  discussion  of  destroyer-submarine  encounters  including 
a  description  of  the  statistical  study  and  its  application  to  game 
theoretic  models  is  contained  in  Chapter  B.  The  chapter  also  reviews 
several  num.erical  results  which  have  been  obtained  with  the  models. 

The  analysis  of  barrier  penetration  problems  is  contained  in 
Chapter  C.  Following  that,  in  Chapter  D,  is  a  combined  discussion 
of  instantaneous  probability  detection  models  and  of  procedures  for 
fitting  detection  models  to  observed  data  obtained  from  exercises  at 
sea.  The  last  chapter.  Chapter  E,  contains  the  text  of  the  paper, 

"The  Distribution  of  the  Transit  Point  in  a  Submarine  vs.  Destroyer 
Game.  " 
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B.  DESTROYER-SUBMARINE  ENCOUNTERS 

1.  The  Model  Scenario 

As  indicated  in  the  introductory  chapter,  a  statistical  model 
has  been  developed  to  assesa  the  probability  of  undetected  pene¬ 
tration  by  a  submarine  of  a  destroyer  screen  or  barrier.  This  is 
accomplished  by  replicating  the  expected  tracks  of  the  ships  under 
specific  assumptions  about  tactics  and  encounter  conditions.  Using 
these  tracks  and  the  instantaneous  probability  detection  model,  the 
submarine's  probability  of  survival  is  determined.  Because  there 
are  random  elements  in  such  encounters,  several  replications  of 
the  encounter  are  used  to  obtain  an  average  probability  of  survival. 
The  Figure  B-l  depicts  the  patrol  areas  of  the  defending 
destroyers.  In  each  area  a  destroyer  is  represented  schematically 
by  a  vessel-shaped  figure,  the  vector  through  the  vessel  represent¬ 
ing  the  direction  and  speed  of  movement.  The  submarine  cruising 
in  front  of  the  screen  is  represented  by  a  similar  figure,  again  with 
a  vector  representing  direction  and  speed. 

The  sixbmarine,  approaching  from  the  bottom,  may  attempt 
to  proceed  directly  through  the  screen,  may  move  toward  a  gap  area 
and  proceed  directly  through,  or  may  cruise  or  lie  dead  in  the  water 
outside  the  barrier  for  a  period  before  attempting  a  transit.  The 
choice  depends  on  the  information  available  to  the  submarine's 
commander  and  upon  his  evaluation  of  that  information.  The  des¬ 
troyers  are  assumed  always  to  be  in  an  active  sonar  mode.  Thus 
the  submarine  will  be  able  to  hear  a  destroyer  at  some  distance. 
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DSUB,  which  generally  will  be  much  greater  than  the  distance, 

RMIN,  at  which  the  destroyer  has  a  nonzero  probability  of  detect¬ 
ing  the  submarine.  The  information  obtained  by  the  submarine  when 
it  is  within  DSUB  of  a  destroyer  allows  it  to  determine  t  ^e  location, 
course,  and  speed  of  the  destroyer.  We  have,  for  the  purposes  of 
this  model,  assumed  that  this  is  the  only  source  of  such  information 
to  the  siibmarine.  A  detailed  discussion  of  the  way  the  submarine's 
response  has  been  modelled  is  contained  in  section  3  below  on  sub¬ 
marine  strategies. 

The  destroyers  continually  patrol  their  sectors  according  to 
patterns  which  usually  involve  random  elements.  The  instantaneous 
probability  detection  model  described  in  Chapter  D  is  used  for  model¬ 
ing  the  destroyers'  sonar  capabilities.  In  addition  to  the  destroyers, 
a  nximber  of  passive  sonobuoys  may  be  placed  throughout  the  screen. 
This  tends  to  discourage  submarines  from  spending  long  hours  in  the 
information  gathering  region.  Various  patterns  of  sonobuoys  may  be 
assumed  but  wc  have  only  implemented  a  \miform  type  of  distribution. 
As  a  logical  extension,  one  might  consider  a  distribution  which 
increases  the  likelihood  of  exposure  for  a  submarine  travelling 
tov/ard  and  through  gaps.  The  correct  solution  of  this  problem  re¬ 
quires  the  use  of  game  theory. 

The  detection  model  used  for  sonobuoys  is  the  more  conven¬ 
tional  "cookie-cutter"  type  in  which  a  submarine  is  always  detected 
within  range  SMIN  and  never  outside  that  range.  The  value  of  SMIN 
is  a  function  of  U,  the  submarine  speed,  in  the  usual  manner.  The 
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distribution  of  sonobuoys  is  used  with  the  detection  model  to  obtain  a 
probability  of  detection  for  a  submarine  following  a  particular  path  at 
specified  speeds.  Because  the  threat  of  detection  is  dispersed,  it 
is  less  critical  whether  an  instantaneous  probability  detection  model 
is  used  and  we  have  found  it  quite  satisfactory  in  this  instance  to  use 
a  "cookie -cutter"  model.  To  accommodate  different  scenarios,  the 
number  of  sonobuoys  (expressed  as  a  ratio  r  to  the  number  of  des¬ 
troyers)  is  treated  as  variable.  For  example,  a  convoy  destroyer 
screen  may  have  no  sonobuoys  (r  =  0)  whereas  a  stationary  destroyer 
barrier  may  have  many  (say,  r  =4).  The  details  of  sonobuoy  deploy¬ 
ment  are  described  below  in  Section  4  on  sonobuoy  deployment. 

In  the  first  chapter  and  above  in  this  section  we  have  indicated 
in  a  general  way  the  patrol  strategies  available  to  the  destroyers. 

In  the  following  section,  we  develop  this  in  detail. 


Figure  B-2.  Back  and  Forth  Patrol 
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(b)  Random  segments  in  random  directions  within  the  zone. 
The  destroyer  performs  straight  line  segments  within 
the  zone  as  follov/s: 

.  W 


Figure  B-3.  Random  Patrol 


At  the  start  of  each  leg  a  direction  is  chosen  randomly 
within  —  45%  of  the  midline.  With  some  probability 
the  destroyer  may  reverse  course  at  the  start  of  each 
leg;  otherwise  it  continues  until  a  boundary  is  reached. 
The  procedure  for  selecting  each  new  leg  is  as  follows: 

(i)  Qf  the  four  possible  quadrants,  the  destroyer  will 

usually  tend  to  keep  going  in  the  same  E-W  direction. 

However,  he  will  occasionally  reverse  E-W 
direction.  The  choice  of  upper  or  lower  quadrant 
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is  made  with  equal  probability,  independent 
of  the  previous  direction. 


Usual  q\iadrant  choice 


Figure  B-4.  Choice  of  Quadrant 

(ii)  Once  the  quadrant  has  been  chosen,  the  angle  made 
with  the  E-W  line  is  chosen  randomly,  from  the 
uniform  distribution  on  the  range  [0°  ,  45°  ]  . 

This  follows  a  suggestion  by  Fischer  [2].  Paths 
which  approach  more  nearly  to  the  N-S  direction 
"waste  time"  when  seeking  a  submarine,  transitting 
in  the  N-S  direction.  The  range  of  angles  chosen 
gives  a  reasonable  chance  of  catching  a  submarine 
which  is  lying  in  wait  (or  proceeding  in  an  E-W 
direction). 

(iii)  Once  a  path  is  chosen,  it  is  followed  until  the  boundary 
of  the  box  is  reached.  This  places  obvious  restrictions 
on  the  next  choice  of  quadrant.  A  procedure  in  which 
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path  length  is  chosen  randomly  (within  allowable 
limits)  was  tried,  and  dropped.  It  used  excessive 
computer  time,  and  contributed  little  to  effective 
destroyer  search. 

(c)  Zig-zag  path  at  45°  to  E-W  line.  The  destroyer  moves 
back  and  forth  along  a  broken  line  with  each  leg  at  a  45° 
angle  with  the  midline. 


Figure  B-5.  Zig-zag  Patrol 

With  some  probability,  the  destroyer  may  reverse  course 
at  the  start  of  each  leg. 

The  parameter  used  to  determine  the  frequency  of  random 
reversals  (or  random  changes  from  quadrants  1,4  to  2,3  and  vice- 
versa  in  case  (2)  will  be  called  W  ("WEIGHT"  in  the  program  listing). 
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W  =  1  corresponds  to  no  random  reversals.  Patterns  (1)  and  (3) 
are.  thus  completely  predictable.  Pattern  (2)  will  not  be  predictable, 
because  the  angle  with  the  E-W  line  is  still  chosen  randomly,  but 
the  destroyer  will  proceed  regularly  from  one  end  of  the  barrier  to 
the  other.  W  =  .  5  corresponds  to  50%  reversals.  W  less  than  .5 
is  not  used,  since  more  frequent  reversals  than  50-50  would  serve 
no  purpose  (a  number  of  runs  with  W  less  than  .  5  were  made  to 
verify  this). 
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3.  Description  of  Submarine  Strategies 

The  submarine,  of  course,  proceeds  due  North  across  the 
barrier,  if  it  hears  no  pings.  K  it  hears  only  one  destroyer,  it  may 
keep  going  North,  or  take  a  sidestep  (E  or  W)  until  his  Northerly 
course  can  be  resumed  without  danger. 

The  basic  choices  for  the  submarine  thus  are  a)  to  attempt 
transit  through  the  barrier  segment  that  presents  itself  as  the  submarine 
approaches  the  barrier,  using  sidesteps  if  necessary  and  maintaining  a 
constant  speed;  or  b)  to  seek  the  end  of  a  destroyer  segment  (”end-run"j 
by  determining  the  larger  gap  between  the  three  destroyers  facing  the 
submarine,  proceeding  East  or  West  to  that  gap,  and  holding  to  the  mid¬ 
line  of  the  gap  in  proceeding  North.  It  may  wait  dead  in  the  water  before 
proceeding. 

The  optimal  choice  will  depend  on  the  lambda  constant  for  the 
destroyer's  sonar  equipment.  For  low  lambda  (poor  equipm'»at),  a 
direct  transit  ma^r  be  preferable. 

If  the  submarine's  speed  is  relatively  slow  -  in  the  range  3-l0 
knots  -  it  may  be  advisable  to  ignore  a  destroyer  even  if  it  is  heard, 
provided  that  the  destroyer  stays  more  than  the  maximum  sonar  range 
away.  A  fast  submarine,  on  the  other  hand,  can  afford  to  take  evasive 
action  whenever  the  predicted  closest  point  of  approach  (CPA)  is  less 
than  sonar  range. 

If  the  submarine  has  heard,  or  hears  at  present,  two  or  more 
destroyers,  it  may  attempt  a  "gap -splitting"  strategy.  If  only  two 
destroyers  are  heard,  it  would  initially  go  for  the  "unprotected"  side 
of  the  nearer  one.  ["End-run"]  K  three  are  heard,  it  would  split  the 
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larger  gap.  Wa  assume  that  the  submarine  keeps  records  of  the 
Westmost  and  Eastmost  positions  of  each  destroyer  heard  (and 
that  it  can  discriminate  between  them).  The  end- run  case  would 
be  converted  to  gap-split  if  another  destroyer  were  encountered. 

Alternatively,  when  the  submarine  hears  a  second  destroyer, 
it  could  simply  concentrate  attention  on  the  closest,  or  poten¬ 
tially  most  dangerous  one  (taking  account  of  the  destroyers' 
current  course),  and  ignore  the  others.  ("No  Split"  strategy.  ) 

The  choice  between  these  two  alternative  types  of  strategy 
will  depend  on,  among  other  parameters,  the  spacing  between 
barrier  segments  chosen  by  the  destroyers.  Their  object  should 
be  to  present  the  submarine  with  equally  desirable  alternatives, 
so  that  the  probability  of  detection  remains  constant  whichever 
strategy  is  chosen. 

We  have  now  specified  strategy  when  two  ore  more  destroyers 
have  been  heard.  Let  us  return  to  the  case  where  only  one  is  heard, 

or  when  the  submarine  decides  to  consider  only  the  most  dangerous 
one  (the  latter  is  called  the  "no  split"  case). 

Upon  detecting  a  destroyer,  the  following  closest  points  of 
approach  (CPA's)  are  calculated.  It  is  assiarned  that  the  submarine 
immediately  determines  the  destroyer's  course. 


^  .-’ 


(a)  CPAg^  -  the  resulting  CPA  if  the  submarine  maintains 
his  present  course 

(b)  CPA  .  -  the  CPA  that  results  if  the  submarine 

stop 

adopts  an  Easterly  (or  Westerly  -  whichever  is  better) 
course. 

Both  of  these  CPA's  are  continuously  monitored. 

If  the  submarine  is  advancing  in  a  Northerly  direction,  it  uses 
the  rules: 

If  CPAg^  >  RMINP,  then  continue  the  Northerly  course 

If  CPA  <  RMINP,  but  CPA  >  GNGFAC  •  CPA  .  ,  also 
go  go  -  stop* 

continue  Northerly.  The  value  of  GNGFAC  (Go/No-Go 
Factor)  is  a  submarine  decision  factor  which  is  usually 
set  to  about  three  quarters. 

Otherwise,  adopt  the  better  Easterly  or  Westerly  direction. 
If  the  submarine  is  in  the  East- West  mode,  it  uses  the  rule: 

As  soon  as  CPA^^  >  RMINP,  begin  a  Northerly  course. 

We  define  a  parameter  RMINP  as  follows:  the  submarine  maneu¬ 
vers  taking  sidesteps  when  necessary  so  as  to  keep,  if  possible,  the 
predicted  CPA  with  the  destroyer  greater  than  the  distance  RMINP. 
Unless  his  speed  is  very  fast,  he  will  not  always  be  successful. 

We  have  chosen  to  relate  RMINP  to  RMIN,  the  destroyer's  sonar 
range  or  maximum  distance  at  which  it  has  a  positive  probability  of 
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detecting  the  submarine.  This  seems  reasonable  because  as  sonar  is 
improved  the  usual  consequence  is  to  enlarge  the  patrol  sectors  and, 
in  general,  to  scale  up  all  of  the  distance  parameters  in  the  model. 
Thus  we  define 


RMINP  =  CC*  RMIN 

where  CC  is  a  constant  specified  initially  and,  possibly,  modified 
during  the  encounter.  Values  of  CC  greater  than  one  are  progressively 
more  cautious  while  values  less  than  one  are  progressively  more  bold. 

A  value  of  CC  equal  to  zero  means  the  destroyers  will  be  ignored. 

Suppose  the  submarine  comes  closer  to  the  destroyer,  than 
RMINP.  This  is  an  indication  that  the  value  of  RMINP  chosen  originally 
was  too  cautious.  In  this  event,  then  CC  is  reduced  by  a  factor  a  less 
than  one;  thus  the  submarine  becomes  increasingly  bold.  If  the  destroyer 
again  approaches  within  the  new  RMINP,  it  is  reduced  by  Cl  again,  and  so 
on,  until  the  sumbarine  becomes  sufficiently  bold  to  attempt  transit 
on  the  next  favorable  opportunity.  This  factor  a  we  call  the  learning 
factor.  In  the  principal  runs  obtained  during  this  study  a  was  set  to  one- 
half.  Table  VII  represents  a  brief  study  of  the  effects  due  to  variation 
of  a.  Further  research  might  profitably  analyze  the  sensitivity  of  this 
number  and  attempt  to  relate  it  to  observed  behavior.  It  would  be 
especially  interesting  to  find  wheatherCC  and  CC  are  correlated. 

The  introduction  of  these  two  factors  is  an  attempt  to  assist 
the  development  of  a  model  of  a  submarine's  behavior  in  this  type  of 
encounter  scenario.  The  factors  reflect  a  commander's  initial  and 
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subsequent  assessment  of  jill  threats  which  exist  if  a  transit  is 
not  attempted  immediately  or  if  he  stops  during  penetration  to  take 
evasive  action. 


4^  Description  of  Sonobuoy  Strategies 


Passive  sensors  are  aSsiamed  to  have  the  following  character¬ 


istics: 


(i)  They  are  distributed  randomly  over  a  specified 
area;  for  simplicity,  the  area  used  is  the 
full  barrier  with  the  addition  of  strips  along 
the  North  and  South  edges  of  width  RMIN. 

(ii)  The  mode  of  detection  is  cookie -cutter,  with  radius 
R.;  that  is,  detection  is  certain  if  the  submarine  ever 
comes  within  range  R  of  any  passive  detector. 

(iii)  The  value  of  R  depends  on  the  speed  of  the 
submarine.  The  formula  used  is  given  in 
Appendix  B-III. 


The  nxamber  of  passive  sensors  is  expressed  as  ratio  to  the 
number  of  active  destroyers.  This  is  appropriate  since  the  sonobuoys 
are  associated  with  the  destroyer  sectors  and  constant  ratios  imply 
constant  sector  strength.  The  ratio  is  denoted  by  r.  K  it  is  assumed 
that  each  destroyer  acts  simultaneously  (and  continuously)  as  a  passive 
detector,  then  r  must  be  at  least  1.  Hov/ever,  values  of  r  =  0, 
and  .  5,  are  included  in  our  analysis,  for  completeness,  as  well 
as  r  =  1. ,  2. ,  4. ,  6. 

The  probability  of  surviving  detection  by  passive  sensors  is 
computed,  using  a  simple  formula  given  in  Appendix  B-III.  This 
survival  probability  is  multiplied  by  the  previously  obtained  survival 


probability  relating  to  active  sonars. 


5.  ResTilts  of  the  Model 

The  value  of  the  present  model  using  the  db.  -min,  concept 
of  instantaneous  probability  of  detection  is  shown  in  the  program's 
sensitivity  to  a  large  ntimber  of  control  parameters.  The  sim\ilation 
progrcun  was  also  run  with  a  "cookie -cutter"  detection  model  to 
contrast  the  significantly  greater  sophistication  available  with  the 

4 

db-min  detection  model.  Optimal  strategic  choices  change  as  the 
condition  of  the  destroyers  equipment  or  the  background  noise 
varies.  Such  differences  can  not  be  simulated  in  any  acceptable 
manner  using  cookie-cutter  detection  concepts. 

Since  the  model  incorporates  a  large  number  of  parameters, 
complete  testing  under  all  combinations  of  parametric  variation  was 
computationally  unfeasible.  Instead,  situational  parameters,  (e,  g. , 
barrier  geometery)  were  set  equal  to  standard  values  and  the 
'v  strategic  parameters  (e.  g. ,  submarine  speed  and  destroyer  patrol 
pattern)  were  varied.  The  effect  of  variation  in  the  situational  pa¬ 
rameters  was  investigated  by  allowing  various  subsets  of  the  pa¬ 
rameters  to  vary  singly  for  a  limited  number  of  strategy  choices. 
Careful  examination  of  the  results  of  the  simulation  runs  gives 
great  insight  into  the  complex  interaction  between  strategic  and 
situational  parameters. 

The  results  in  the  first  five  sets  of  tables  were  obtained  holdr 
ing  the  following  situational  parameters  fixed  at  the  values  indicated: 
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RMIN 

“ 

10. 

= 

Destroyer  maximum  sonar  range 

DSUB 

= 

20. 

= 

Submarine  maximum  sonar  range 

BARWID 

= 

20. 

= 

Half  width  of  destroyer  patrol  box 

BARDEP 

= 

5. 

= 

Half  depth  of  destroyer  patrol  box 

HORFCT 

= 

2. 

5 

= 

Horizontal  spacing  factor  between  destroyers 

VERFCT 

= 

0. 

= 

Vertical  spacing  factor  between  destroyers 

DESTNO 

= 

3 

= 

Number  of  destroyers 

RDFAC 

= 

0. 

5 

= 

Reduction  factor  for  RMINP 

GNGFAC 

= 

0. 

75 

= 

Go /No -go  decision  factor 

V 

= 

17. 

= 

Destroyer  speed  (kts.) 

Game  matrix  entries  were  derived  only  as  necessary  to  locate  the 
solution  strategies.  The  following  four  basic  and  illustrative  game 
matrices  will  be  discussed  in  detail: 


Table  I-a:  Probability  of  undetected  barrier  transit  under 

"average"  equipment  or  sea  state  conditions  with 
no  passive  sensors  deployed  (X  =  0.  1  db  -  min,  r  =  0). 


Table  Il-a:  Probability  of  \indetected  barrier  transit  under  "good" 
equipment  or  sea  state  conditions  with  no  passive 
sensors  deployed  (X  =  1.0  db  -  min,  r  =  0), 

Table  Ill-a:  Probability  of  undetected  barrier  transit  under  "average" 
equipment  or  sea  state  conditions  with  four  passive 
sensors  deployed  per  active  sonar  (X  =  0.  1  db  -  min,  r  =  4) 


Table  IV-a:  Probability  of  xmdetected  barrier  transit  under  "good" 
equipment  or  sea  state  conditions  with  four  passive 
sensors  deployed  per  active  sonar  (X  =  1.  0  db  -  min,  r  =  4) 


Tables  I-b,  11-b,  Ill-b,  IV-b  tabulate  the  game  theoretic  solutions  for 
the  corresponding  game  matrices  as  detailed  above.  The  derivation 
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of  strategy  solutions  requires  the  following  reasonable  premises: 

i)  The  destroyer  knows  the  maximum  submarine  speed 

ii)  The  destroyer  chooses  a  patrol  pattern  and  a  course 
reversal  frequency 

iii)  The  submarine  knows  the  choice  of  patrol  pattern  and 
course  reversal  rate  made  by  the  destroyer 

iv)  The  submarine  chooses  a  speed  (less  than  or  equal  to 
his  maximum  speed)  and  a  caution  factor. 

These  choices  arc  denoted  by: 

IZIG  =  destroyer  patrol  pattern 

WEIGHT  =  destroyer  course  reversal  frequency 

(WEIGHT  =0.5  implies  50%  course  reversal 
0.  7  implies  30%  course  reversal 
1.0  implies  no  course  reversal) 

U  =  submarine  speed 

CC  =  submarine  caution  factor. 

The  results  of  the  simulation  runs  when  the  program  was  set  to  use 
a  cookie-cutter  detection  model  are  exhibited  in  Table  V-a.  Table  V-b 
lists  the  corresponding  optimal  strategies  based  upon  this  model  of 
detection.  Comparis  ms  between  Tables  I  through  IV  and  Table  V 
demonstrate  clearly  and  effectively  the  importance  of  the  db  -  min 
or  instantaneous  probability  of  detection  concept. 

The  results  displayed  in  Tables  VI  through  X  were  derived 
from  the  model  by  holding  the  strategic  parameters  fixed  at  one  of 
two  sets  of  values.  Tests  were  made  to  demonstrate  the  sensitivity 
of  the  simulation  program  to  a  number  of  critical  and/or  interesting 
parameters. 
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Table  VI  presents  the  effect  of  variation  in  DSUB,  the  sub¬ 
marine's  maximum  sonar  range.  The  next  two  tables  (VII  and  VIII) 
tabulate  the  resxxlts  of  an  examinatiation  into  two  of  the  factors  which 
govern  the  submarine's  movement  through  the  patrol  barrier.  Table  VII 
displays  the  resvilts  of  changes  in  RDFAC,  the  factor  by  which  the  de¬ 
sired  avoidance  distance  (RMINP)  is  reduced  whenever  the  destroyer's 
motion  violates  this  bound.  In  Table  VIII  are  listed  the  simulation 
resiilts  due  to  variation  of  the  parameter  GNGFAC;  this  parameter 
controls  the  submarine's  decision  whetner  to  go  North  or  to  wait 
(see  Appendix  B-I).  The  geometric  aspects  of  the  barrier  patrol 
box  are  the  subject  of  Tables  IX  and  X.  Table  IX  displays  the  effect 
that  BARDEP,  the  half  depth  of  the  patrol  box,  has  on  the  probability 
of  undetected  transit.  The  results  of  variation  in  the  gap  size  are 
stimmarized  in  Table  X. 

Probability  entries  in  all  the  tables  of  this  section  denote 
the  probability  that  the  submarine  will  achieve  undetected  transit 
of  the  patrol  barrier  starting  from  a  distance  RMIN  in  front  of  the 
destroyer  patrol  box  and  ending  at  a  distance  of  RMIN  past  the  patrol 
box.  It  must  be  emphasized  that  the  results  are  subject  to  rather 
large  standard  deviations.  For  some  probabilitic  entries  the  con¬ 
fidence  interval  at  the  90%  level  were  derived.  Where  calculated, 
these  are  displayed  in  the  form  t.  Ox.  The  conclusions  drawn  from 
the  data  are  therefore  tentative  and  shoxild  be  subjected  to  further 
investigation.  However,  the  preliminary  inferences  of  this  section 
are  believed  to  be  indicative  of  the  correct  evaluation  of  the  ASW  problem. 
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IZIG  =  destroyer  patrol  pattern 

WEIGHT  =  destroyer  frequency  of  course  reversal,  where 
increased  course  reversal  is  reflected  in  lower 
values  of  this  parameter. 

All  tables  will  be  found  at  the  end  of  this  section  beginning  on  page  44, 
Tables  I-a  and  I-b 

The  entries  in  Table  I-a  were  derived  assuming  "average" 
equipment  and  sea  states  wit'i  no  passive  sensors  deployed.  The 
solutions  to  this  game  matrix  are  presented  in  Table  I-b,  The 
table  serves  as  a  good  illustration  of  the  sensitive  nature  of  the 
ASW  problem.  As  the  maximum  submarine  speed  varies  no  overall 
structure  is  developed  in  the  optimal  strategy  choices.  Only  when 
the  submarine  is  capable  of  speeds  over  10  knots  does  any  pattern 
develop:  the  destroyer  should  choose  the  method  of  random  patrol 
and  r.,/erse  course  with  frequency  0.5.  This  strategy  may  be  inter¬ 
preted  to  mean  that  for  relatively  high  submarine  speeds,  the  destroyer 
patrol  shoTild  be  as  unpredicable  as  possible.  The  submarine's  pro¬ 
bability  of  achieving  undetected  penetration  through  the  barrier  are 
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so  high  that  the  destroyer's  best  strategy  is  to  use  chance  to  trap 
the  submarine  within  sonar  range. 

Tables  Il-a  and  Il-b 

In  these  tables  "good"  equipment  and/or  sea  states  are 
assumed.  Again  no  passive  sonars  are  deployed.  Of  particular 
interest  are  the  solution  strategies  shown  in  Table  Il-b.  The 
choices  display  significant  differences  when  compared  to  Table  I-b. 
These  can  be  attributed  to  the  improved  value  of  For  low  values 
of  the  probability  of  no  detection  under  optimal  strategy 

choices  is  considerably  reduced: 


^MAX 

Pr  (no  dfclection) 

X  =  1. 0  db  -  hrs. 

Pr  (no  detection) 

X  -  0.  1  db  -  hrs. 

Differences 

3 

.010 

.295 

.285 

5 

.  118 

.  511 

.  393 

7 

.254 

.  621 

.  367 

10 

.  514 

.  809 

.  295 

When  the  destroyers  face  a  submarine  capable  of  higher  speeds  the 

effective  differential  of  better  equipment  and/or  sea 

off  rapidly: 

states  falls 

^MAX 

Pr  (no  detection) 

X  =  1. 0  db  -  hrs. 

Pr  (no  detection) 

X  =  0.  1  db  -  hrs. 

Differences 

13 

.677 

.  865 

.  188 

15 

.813 

.921 

.  108 

17 

.843 

.  921 

.  078 
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T’he  game  solutions  show  little  regularity  except  for  CC,  the  caution 
factor,  which  is  generally  equal  to  1.  This  implies  the  submarine 
should  neither  be  very  bold  nor  very  cautious.  The  optimal  frequency 
of  course  reversals  (WEIGHT)  tends  to  indicate  that  trapping  the 
submarine  is  a  preferred  strategic  choice  at  higher  submarine  speeds. 
By  trapping  we  mean  that  the  submarine,  having  begun  a  transit 
attempt  as  the  destroyers  moved  away,  is  caught  when  one  of  them 
unexpectedly  reverses  course.  The  best  speed  for  the  submarine 
is  in  every  case  equal  to  the  maximum  allowable.  The  probable 
interpretation  of  this  resiilt  is  that  the  submarine  does  best  to  transit 
the  barrier  as  qvdckly  as  possible;  the  submarine  thereby  reduces 
the  possible  time  it  may  be  exposed  to  the  destroyers'  sonar  to  a 
minimum,  not  worrying  about  the  extra  noise  generated  at  high 
speed. 

Tables  Ill-a  and  Ill-b 

The  data  in  these  tables  are  the  result  of  running  the  simul¬ 
ation  program  under  the  hypothesis  of  "average"  equipment  and/or 
sea  state.  However  passive  sonar  detectors  were  sim\ilated  in 
addition.  A  ratio  of  four  passive  sensors  per  active  sensor  was 
used. 

The  addition  of  passive  detectors  had  its  most  significant 
effect  at  average  and  high  submarine  speeds  (assuming  optimal 
strategies  are  chosen): 
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MAX 

Pr  (nc  detection) 
with  pa.ssive  detectors 

Pr  (no  detection)  with 
no  passive  detectors 

Difference 

17 

.  304 

.  921 

.  617 

15 

.  304 

.  921 

.  617 

13 

.  304 

.  865 

.  56l 

10 

.  304 

.  809 

503 

7 

.  303 

.  621 

.  318 

When  the  destroyers  face  submarines  with  low  maximum  speeds  the 
range  for  possible  improved  detection  is  limited  and  deployment  of 
passive  detectors  is  not  as  efficient  as  improved  equipment. 

^lUAV  detection)  Pr  (no  detection)  with  Difference 

with  passive  detectors  no  passive  detectors 

5  .288  .  511  .223 

3  .178  .295  .117 

The  optimal  strategic  choice  of  the  destroyer  stabilizes  for  submarine 
speeds  of  7  knots  or  greater.  The  submarine's  optimal  strategic 
choice  becomes  fixed  if  speeds  of  10  knots  or  greater  are  possible. 
The  rate  of  destroyer  course  reversals  is  less  than  in  previous 
tables  where  no  passive  detectors  were  deployed.  The  implication 
is  that  passive  sonars  provide  the  defenders  with  sufficient  extra 
listening  capability,  reducing  the  need  for  trapping  the  submarine. 
More  emphasis  can  be  placed  by  the  destroyers  on  a  systematic 
search. 
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The  most  notable  feature  of  Table  Ill-b  is  the  limitation  on 
the  submarine's  optimal  speed  to  10  knots.  The  significant  differences 
between  optimal  and  maximvim  available  speeds  is  explained  as  follows: 
the  fact  that  passive  detectors  are  deployed  randomly,  means  the  sub¬ 
marine  can  not  predict  their  location.  (The  destroyers  generate 
enough  noise  oonder  our  assvimption  that  any  destroyers  course  and 
position  can  be  determined  when  submarine  and  destroyer's  course  and 
within  a  distance  of  DSUB,  which  equals  20  n. m.  in  these  tables. ) 

Thus  in  order  that  the  submarine  may  retain  some  chance  of  \andetect- 
ed  transit,  his  speed  must  be  restrained  to  the  threshold  value  of 
10  knots  (though  it  is  interesting  to  note  that  a  threshold  value  of 
5  knots  yields  a  probability  of  no  detection  which  does  not  differ 
within  any  statistical  significance.) 

Tables  IV -a  and  IV -b 

In  these  tables  the  probabilities  of  undetected  transit  and  the 
associated  game  theoretic  solutions  are  considered  under  conditions 
of  "  good"  equipment  and  sea  state  with  the  deployment  of  passive 
sonars  in  a  ratio  of  4:1  to  active  sensors.  The  reductions  in  the 
probability  of  vindetected  transit  at  the  game  solutions  is  drsimatic: 
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u 

Pr  (no  detection) 

X  =  1. 0  db  -  hrs, 
with  passive  detectors 

Pr  (no  detection) 

X  =  0.  1  db  -  hrs. 
no  passive  detector 

Difference 

3 

.  010 

.  295 

.  285 

5 

.069 

.  511 

.  442 

7 

.117 

.  621 

.  504 

10 

.  173 

.  809 

.  636 

13 

.  173 

.  865 

.  692 

15 

.  173 

.  921 

.  748 

17 

.  182 

.  921 

.739 

The  submarine's  optimal  speed  is  essentially  limited  to  7  knots.  The 
case  where  the  submarine's  maximum  allowable  speed  is  17  knots 
(which  equals  the  destroyer  speed)  may  be  considered  in  the  follow¬ 
ing  light.  At  this  threshold  value  the  submarine's  best  policy  is 
to  choose  his  time  and  transit  path  carefully,  thereby  completely 
avoiding  active  sonars  while  taking  the  chance  that  few  passive 
sonars  are  within  sonar  range. 

This  conclusion  is  supported  by  the  fact  that  a  caution  factor 
of  2  is  optimal  and  that  the  mean  path  length  of  the  submarine  transit 
is  significantly  greater  than  usual  (50  n. m.  versus  38  n.m.),  i.  e. 
the  submarine  has  spent  considerable  time  moving  East  to  West  be¬ 
fore  proceeding  North.  The  best  destroyer  policy  is  to  adopt  a 
pattern  with  no  course  reversals,  the  randomization  of  motion  angles 
in  pattern  2  being  sufficiently  unpredictable  in  these  situations. 
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1 

I 
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Tables  V-a  and  V-b 


0 

0 

0 

0 


The  results  derived  from  running  the  simulation  program  with 
the  relatively  unsophisticated  cookie-cutter  model  of  detection  are  dis¬ 
played  in  these  tables.  The  inadequacy  of  using  this  method  to  sim¬ 
ulate  the  destroyers'  sonar  gear  is  obvious  in  that  there  is  no  satis¬ 
factory  match  between  optimal  strategies  under  the  two  modes.  The 
probabilities  of  \mdetected  penetration  of  the  barrier  most  nearly 
match  the  db -min  model  with  X  =  1*0  db-hrs.  However  whenthe 
submarine  is  restricted  to  low  maximum  speeds  the  differences  are 
highly  significant  and  too  large  to  be  acceptable. 

Solutions  based  upon  the  cookie-cutter  model  can  therefore 
be  seriously  misleading.  In  so  far  as  possible  the  use  of  this  sim¬ 
plistic  model  of  sonar  equipment  should  be  avoided  in  the  analysis  of 
future  exercises  or  simulations. 


c 

u 

u 

n 

U 

ttm 

1 

1 


Table  VI 

The  effect  of  a  variation  in  DSUB>  the  submarine's  maximum 
sonar  range  was  investigated  for  two  typical  strategy  choices.  The 
results  as  displayed  in  this  table  indicate  that  in  some  cases  it  may 
be  of  advantage  to  the  submarine  to  artifically  limit  its  detection 
range  to  a  value  less  than  the  maximal  range.  A  possible  inter¬ 
pretation  of  this  non-intuitive  conclusion  is  as  follows. 

In  the  cases  considered  destroyer  course  changes  and  reversals 
are  a  prominent  random  factor  in  the  pattern  of  motion  the  destroyer 
traces  out  in  time.  The  submarine's  ability  to  predict  the  destroyer's 


! 
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path  is  thereby  severely  restricted.  An  optimal  value  of  DSUB 
less  than  the  maxim\am  possible  suggest  that  the  submarine  should 
not  base  its  own  movement  though  the  barrier  upon  predictions  of 
destroyer  motion  far  into  the  future.  Instead,  the  submarine  should 
limit  his  predictions  to  close  encounter  situations.  In  these  cases 
the  relevant  time  horizon  required  is  short  enough  to  preclude  the 
greater  part  of  random  destroyer  course  changes.  The  submarine 
improves  the  overall  probability  of  no  detection  by  skirting  the 
dangerous  area  of  the  destroyer's  sonar  range.  As  the  destroyer's 
ability  to  detect  the  submarine  improves  the  optimal  value  of  DSUB 
can  be  expected  to  increase  (closer  approach  becomes  more  dan¬ 
gerous  to  the  submarine).  This  deduction  is  borne  out  by  the  fact 
that  when  X  =  1  •  0  db  -  hrs  the  optimal  DSUB  derived  from 
Table  VI  is  greater. 

Table  VU 

The  learning  factor  a  is  described  in  Section  3.  This  table 
investigates  the  sensitivity  of  the  model  to  changes  in  the  value 
chosen  for  a.  As  long  as  a  is  constrained  to  the  values  .5  <  .  9 

for  the  case  U  =  lO.n.  m.  and  to  the  values  .  5  <  a  <  1.  0  for  the 
case  U  =  5.n.  m.  the  resultant  probabilities  of  undetected  transit 
display  statistically  non- significant  variation.  In  general  values  of 
cs:  =  .  9  and  cs:=  1.0  appear  optimal. 


-  37  - 


Table  Vm 

This  table  lists  the  effects  of  variation  in  GNGFAC,  the 
factor  which  governs  the  submarines  decision  whether  to  go  North 
or  to  wait  (see  Section  3).  As  indicated  in  the  table,  at  low  speeds 
GNGFAC  =1.0  appears  to  be  clearly  optimal.  At  higher  submarine 
speeds  GNGFAC  should  be  reduced  to  lie  between  .  75  and  1.  0, 
in  order  that  optimality  be  retained.  These  values  may  be  inter¬ 
preted  to  mean  that  at  low  speeds  the  submarine  should  choose 
his  opportunity  to  head  through  the  barrier  with  greater  caution. 

When  U  =  10  the  submarine  can  display  somewhat  less  caution, 
probably  due  to  the  fact  that  his  time  of  exposure  to  the  defender’s 
sonar  gear  is  significantly  reduced. 

Tables  IX  and  X 

The  geometric  configuration  of  the  destroyer  patrol  boxes 
is  considered  in  these  tables.  Since  the  depth  of  the  barrier  patrol 
box  is  of  no  consequence  to  a  destroyer  using  the  straight  back  and 
forth  type  of  patrol  (IZIG  =  3),  only  one  illustrative  case  is  considered 
in  Table  IX  where  the  results  of  BARDEP  variations  are  listed.  The 
table  reveals  that  for  "average"  equipment  and/or  sea  states  the 
destroyer  should  patrol  a  fairly  shallow  box,  i.  e.  BARDEP  =  2.  5  n.  m. 
is  optimal.  If  "good"  equipment  and/or  sea  states  are  obtained,  the 
barrier  depth  should  be  increased  to  an  optimal  value  BARDEP  =  7.  5  n.  m. 
The  probable  conclusion  to  be  drawn  is  that  when  the  destrover  achieves 
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an  advantage  over  the  submarine  due  to  improved  sonar  ability, 
a  larger  area  can  be  examined.  IVhen  conditions  are  not  so 
favorable  the  destroyer  should  limit  the  search  areas  North- 
South  component.  For  the  case  under  consideration  these  con¬ 
clusions  support  and  verify  the  results  of  Fisher [2]. 

Table  X  was  prepared  according  to  the  following  scheme.  3 
It  is  presumed  that  the  center  points  of  the  destroyer  patrol  box^R 
are  to  remain  50  n.  m.  apart.  Each  value  of  BARWID  will  then  ‘ 
result  in  a  gap  between  the  patrol  boxes.  Though  the  gap  may  be 
swept  by  the  destroyers'  sonars,  they  do  not  enter  the  gap.  If  the 
submarine  can  determine  the  location  and  width  of  the  gap,  it  is 
generally  to  his  advantage  to  transit  the  barrier  by  traveling 
through  the  gap. 

The  results  indicate  that  a  gap  between  patrol  boxes  of 
20  n.  m.  is  optimal  if  no  passive  sensors  are  deployed.  The  optimal 
gap  size  is  0  n.  m.  (i.  e.  no  gap  at  all)  if  passive  detectors  are 
deployed  uniformly  over  the  barrier  in  a  ratio  of  4:1.  If  appears  that 
since  the  passive  detectors  (in  the  present  configuration  of  the 
model)  are  randomly  distributed  throughout  the  patrol  boxes  as 
well  as  in  the  gaps,  the  passive  sensors  intensify  the  destroyer's 
coverage  of  the  boxes.  When  no  passive  detectors  are  present  the 
destroyer  does  best  by  concentrating  his  search  effort  to  a  more 
limited  area,  with  frequent  sweeps  of  his  sonar  into  the  gap.  The 
natural  difficulties  the  submarine  faces  in  attempting  ;o  determine 
the  gap  location  accurately  serve  to  limit  the  submarines  ability 
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to  effectively  utilize  the  large  open  space  between  two  destroyers. 

Care  must  be  taken  in  interpreting  these  tables.  Para- 
rreters  were  varied  individually,  holding  all  other  external  variables 
fixed.  The  results  of  varying  two  parameters  simultaneously  can 
not  always  be  predicted  from  the  single  variation  results.  An 
example  is  illustrative. 

:  Consider  the  case  U  =  10.0,  CC  =  1,  IZIG  =  2,  WEIGHT  =  0.7, 

X  =  0.  1  db-hrs. ,  and  r  =  0,  Table  IX  indicates  that  a  barrier  depth 
of  BARDEP  =  2.  5  is  optimal.  Table  X  allows  the  conclusion  that 
a  gap  size  of  20  n.  m.  is  a  best  choice  for  the  destroyer.  However 
v/hen  the  gap  is  20  n.  m.  ,  BARDEP  =  2.  5  is  no  longer  optimal  as 
illustrated  in  the  following  table. 


BARDEP 
7.  5 
5 

2.5 


Pr  (no  detection) 
.  809 
.  693 
.  805 


With  a  gap  of  20  n. m.  ,  BARDEP  -  5.  is  optimal!  Extensive  research 
is  necessary  in  order  to  determine  the  optimal  values  for  all  para¬ 
meters  that  are  incorporated  into  the  raodel's  structure  simultaneously. 

Several  other  results  were  obtained  from  the  model.  These 
findings  are  of  a  more  general  nature  and  are  graphed  below.  In 
figure  B-6,  the  probability  of  a  submarine  achieving  \mdetected 
penetration  of  the  patrol  barrier  is  graphed  as  a  function  of  the 
maximum  submarine  speed  for  several  values  of  r  (the  passive: active 
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sensor  ratio)o  This  data  is  derived  from  the  case  U  =  10. ,  CC  =  1, 
IZIG  =  2,  WEIGHT  =  0.7,  X  =  0.  1  db  -  hrs. 

Figure  B-7,  shows  the  optimal  submarine  speed  as  a  function 
of  r,  the  ratio  of  passive  to  active  detectors.  The  variable  para¬ 
meters  were  set  as  follows:  CC  =  1,  IZIG  =  2,  WEIGHT  =  0.7, 

X  =  1.  0  db  -  hrs. 
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Table  I-b 

Optimal  Strategies 

X  =  0.  1  db-hrs. ;  No  passive  sensors 


^MAX 

3. 

5. 

7. 

10. 

13. 

15. 

17. 

j 

^OPT 

3. 

5. 

7. 

10. 

i3. 

15. 

15. 

CCopT 

2 

1 

0 

2 

1 

1 

1 

OPT 

1 

3 

1 

1 

2 

2 

2 

WEIGHTqp^ 

1. 

.5 

1. 

1. 

.5 

.5 

.5 

Pr'  ^'^o  detection) 

..295 

.  511 

.621 

.  809 

.865 

.921 

.921 

Table  Il-a 
No  passive  sonars 

Detection  rate:  0.  1  db  -  hrs 


^^^str  IZIG 

1  -  ZIGZAG 

2  - 

'RANDOM' 

3  -  STRAIGHT  LINE 

U  CC 

5 

.7 

1. 

.5 

B 

1. 

.  5 

B 

1. 

3  0 

.  049 

.01 

1. 

.  318 

.  066 

.01 

.  194 

.  230 

.  147 

.  138 

.020 

.  206 

2 

.  081 

.01 

5  0 

.023 

.  163 

.  167 

.034 

.064 

1 

.  438 

.  356 

.118 

.  130 

.  124 

.  283 

..  183 

.  148 

.  430 

2 

.033 

.037 

.  204 

.  157 

.  054 

7  0 

.253 

.284 

.  343 

.  090 

1 

.  597 

.  434 

.265 

.  050 

.  244 

.  372 

.476 

.  248 

.  641 

2 

.  160 

.  354 

.  374 

.  254 

10  0 

.  305 

.441 

.  378 

.  320 

.289 

.  193 

1 

.709 

.610 

.  582 

.  553 

.  6l5 

.  447 

.  514 

.  630 

.  711 

2 

.  606 

.  660 

.428 

.  587 

.  143 

.  234 

13  0 

.490 

.  448 

.  388 

1 

.859 

.  876 

.860 

.  677 

.  606 

.676 

.  785 

.  878 

.  783 

2 

.670 

.699 

.  690 

15  0 

.  544 

.470 

1 

.  896 

.  917 

.881 

.  815 

.  847 

.  825 

.813 

.  933 

.  865 

2 

.731 

.  779 

17  0 

.  600 

.  509 

1 

.943 

.  926 

.943 

.  843 

.  890 

.  825 

.988 

.  99 

.  987 

2 

.769 

.890 

Table  II -b 
Optimal  Strategies 
1  0  db-hrs. ;  No  passive  sensors 


^MAX 

3. 

5. 

7. 

10. 

— 

13. 

15. 

17. 

^OPT 

3. 

5. 

7. 

10. 

13, 

15. 

17. 

CCopT 

1 

1 

2 

1 

1 

1 

1 

IZIGqpt 

1 

1 

3 

3 

2 

3 

2 

WEIGHTqp^ 

1. 

1. 

.7 

.  5 

.  5 

.  5 

.5 

Pr(No  detection) 

0.  10 

.  118 

.  254 

.514 

.  677 

.  813 

.843 

Table  Ill-b 


Optimal  Strategies 

t 

X  =  0.  1  db-hrs. ;  4  passive  sonars  per  active  sonar 


^MAX 

3. 

5. 

7. 

— 

10. 

13. 

15. 

17. 

^OPT 

3. 

5. 

5. 

10. 

10. 

10. 

10. 

CCqpt 

2 

1 

1 

1 

1 

1 

1 

IZIGqpt 

1 

3 

3 

3 

3 

3 

3 

WEIGHTqp^ 

1. 

.  5 

.7 

.  7 

.7 

.  7 

.7 

Pr(No  detection) 

.  170 

.288 

.  303 

.  304 

.  304 

.  304 

.  304 

Table-  IV-b 
Optimal  Strategies 

X  =  1.  0  db-hrs. ,  4  passive  sensors  per  active  sensor 


^MAX 

3. 

5.  . 

7. 

10. 

13. 

15. 

17. 

^OPT 

3. 

5. 

7. 

7. 

7. 

7. 

17. 

^^OPT 

1 

1 

1 

1 

1 

1 

2 

1 

1 

3 

2 

2 

2 

2 

WEIGHT^ 

OPT 

1. 

1. 

.7 

1. 

1. 

1. 

1. 

Pr(No  detection) 

.  010 

.069 

.  117 

.  173 

.  173 

.  173 

.  182 
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Table  V-a 
No  passive  sensors 
Cookie  cutter  detection  model 


^''N^estr  IZIG 

u  cc  ^<11^ 

1  -  ZIGZAG 

2 

•RAN 

DOM' 

3  -  STRAIGHT  LINE 

5 

.7 

1. 

.5 

B 

1. 

.5 

.7 

1. 

3 

0 

.0 

.0 

1 

.  210 

.030 

.0 

.  140 

.  100 

.050 

.  0 

.  0 

.  16 

2 

.040 

.0 

5 

0 

.  0 

.110 

.110 

.0 

.  030 

1 

.  390 

.  320 

.0 

.0 

.  030 

.050 

.  050 

.010 

.  390 

2 

.0 

.0 

.  0 

.0 

.010 

7 

0 

.090 

.  200 

.  320 

.  020 

1 

,  550 

.  350 

.110 

.040 

.  140 

.230 

.213 

.  130 

.620 

2 

.030 

.  300 

.  170 

.0 

10 

0 

.  250 

.  340 

.  260 

.  210 

.  170 

.  150 

1 

.  630 

.  440 

.  440 

.420 

.560 

.  350 

.  380 

.  500 

.630 

2 

.420 

.630 

.  340 

.410 

.  020 

.  100 

13 

■ 

.430 

.  380 

.  330 

1 

H 

.850 

.  790 

.  600 

.  540 

.  630 

.640 

.740 

.760 

2 

■ 

.630 

.  680 

.  650 

15 

0 

■ 

.460 

.  390 

i 

.840 

.  850 

D 

.750 

.  700 

.  640 

.  810 

850 

.  840 

2 

■ 

.620 

.  710 

17 

0 

.  520 

.  450 

i 

1 

.890 

.860 

.840 

.  780 

.  850 

.980 

.970 

2 

.720 
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Table  V-b 
Optimal  Strategies 

Cookie- cutter  detection;  no  passive  sensors 


^MAX 

3. 

5. 

7. 

10. 

13. 

1 - 

15. 

17. 

^OPT 

3. 

5. 

7. 

10. 

13. 

15. 

17. 

^‘"OPT 

- 

- 

1 

1 

2 

1 

1 

iziGqpt 

1 

1 

1 

1 

3 

2 

2 

2 

WEIGHTqp^ 

1 

1 

1 

.5 

.5 

.7 

.5 

Pr(No  detection) 

.000 

.000 

.110 

.  380 

i 

.630 

.700 

.840 

1 

Table  VI 


Case  1 

U  =  10 

CC  =  1 

IZIG  =  2 

WEIGHT  =  .  7 


X  =  0„  I  db  -  hrs. 

X  =  1.0 

db  -  hrs. 

r  =  0 

r  =  4 

r  =  0 

r  =  4 

DSUB  = 

0 

.758^.06 

.  325 

.  515 

,  220 

5 

,845t .04 

.  361 

.  530 

.  227 

10 

.779^  .06 

.  313 

.  512 

.  206 

20 

.84ll'  .04 

.  281 

.  615 

.  206 

25 

.786t  .05 

.277 

.  446 

.  157 

Case  2 

U  =5 

CC  =  1 

IZIG  =  3 

WEIGHT  =  .  5 


X  =  0.  1  db  -  hrs- 

_ 

X  =  1.0 

db  -  hrs. 

r  =  0 

r  =  4 

r  =  0 

II 

DSUB  = 

0 

.  4191  .06 

.261 

n 

m 

5 

.500t  .06 

.  307 

HB 

10 

.  537^  .  06 

.  318 

mm 

20 

.  51lt  .06 

.  288 

■H 

25 

. 385t  .06 

.  213 

HB 

Table  VIII 

Case  I  ■ 

U  =  10 

CC  =  1 

IZIG  =  2 

WEIGHT  =  .  7 


X  =  0.  1  db  -  hrs. 

X  =  1.0 

db  -  hrs. 

II 

O 

mm 

■ 

1 

wm 

GNGFAC=  ,  c 

1.  3 

.aost  .05 

.285 

.  555 

.  197 

1.  0 

. sist  .06 

.267 

.  626 

.  206 

.75 

.84lt  .04 

.281 

.  6l  5 

.  206 

.  50 

.740t  .06 

.288 

.  474 

.  185 

.  25 

.722t  .06 

.264 

.  486 

.  178 

Case  2 

U  =5 

CC  =  1 

IZIG  =  3  • 

WEIGHT  =  .  5 


X  =  0.  1  db  -  hrs. 

o 

• 

II 

db  -  hrs. 

r  =  0 

mam 

r  =  0 

■Hi 

GNGFAC  = 

1.  5 

.493t  .06 

.256 

.  180 

.093 

1.0 

4  1  no 

•  U  lU  -  «  \>V 

♦ 

.  395 

.  227 

.  75 

.  5ut  .06 

.288 

.  183 

.  103 

.  50 

.  456t  .  06 

.264 

.  123 

.  071 

.25 

.  354t  .05 

.210 

.  028 

.016 

;affMrrrr;t>TrrtMr<»ai^ft 


■»»»-.  •ts  •• 


•n-f ' 


I 
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Appendix  B-I.  Subroutine  WAIT 

This  subroutine  determines  whether  the  submarine  can  safely  proceed 
North;  if  not,  it  determines  the  length  of  time,  denoteu  by  symbol  AA ,  that 
it  is  necessary  to  "Wait"  (defined  below)  before  it  is  safe  t  proceed,  assuming 
the  destroyer  maintains  its  present  course.  If  the  destroyer  changes  course 
during  this  "Wh^it"  period,  the  situation  is  re-examined.  The  purpose  of  this 
subroutine  is  to  advance  the  time  of  the  next  examination  of  the  situation  as 
far  as  possible;  it  is  not  necessary  to  consider  events  in  the  interim.  This 
simulation  thus  differs  from  the  conventional  simulation  procedure  in  which 
time  proceeds  in  regular  intervals  of  (say)  .1  hours. 

Two  procedures  are  available  during  the  "Wait"  period. 

(1)  Only  one  destroyer  has  been  detected 

We  calculate  the  required  Wait,  on  the  basis  that  during  the  Wait 
period  the  submarine  proceeds  either  to  the  East  or  to  the  West  at  speed  U. 
During  this  period,  a  CPA  (closest  point  of  approach)  is  experienced  with  the 
destroyer.  The  direction  -  East  or  West  -  yielding  the  largest  CPA  is  chosen. 
In  the  event  that  the  two  CPA's  are  equal  (this  happens  when  the  destroyers 
track  is  precisely  in  the  E-W  direction),  the  direction  leading  away  from  the 
destroyer  is  chosen. 

(2)  Two  (or  more)  destroyers  have  been  detected 

The  submarine  is  required  to  lie  d.i.w.  (dead  in  water)  during  the 

Wait  period.  The  motivation  for  this  is  that,  in  most  situations,  a  movement 
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to  the  East  or  West  would  be  of  no  advantage  when  opposing  two  destroyers  , 
and  would  increase  the  chance  of  detection  through  passive  means. 

Analysis 


The  solid  line 


indicates  destroyer  motion  relative  to 


the  submarine  during  the  WAIT  period.  The  submarine's  absolute  velocity 


during  this  time  is 


U  or  U  (two  cases) 


(ii)  zero,  (d.i.w.) 

according  to  the  description  in  the  previous  section. 

The  dotted  line -  indicates  destroyer  relative  motion  after 

the  Submarine  resumes  its  Northerly  motion,  and  results  in  a  CPA  of  pre¬ 
cisely  RMINP  (provided  destroyer  motion  does  not  change). 

All  co-ordinates  are  destroyer  positions  relative  to  the  submarine. 
(XRl  ,YR2)  is  the  initial  relative  position  of  the  destroyer  (XR2,YR2)  is  an 
arbitrary  position  along  this  relative  track  of  the  destroyer,  used  to  define  the 
track  conveniently.  (XINT.YINT)  corresponds  to  the  time  at  which  the  sub¬ 


marine  resumes  its  Northerly  course. 


O  (Submarine) 


(XINTjYINT)  are  obtained  as  the  solution  for  (X.Y)  of 

Y  -  YRl  =  tan  0  (X  -  XRl) 

(Y  -  RMIN  •  cos  y  )  =  (X  +  RMIN  sin  Y  )  tanY 

(+)  (-) 

Or  (after  some  manipulation) 

RMIN 

(tan0  -  tan  Y  )  X  =  +  - ^  +  (tan  0  •  XRl  -  YRl)  . 

(-) 

Note  that,  taking  RMIN  to  be  +  or  we  obtain  two  formal  solutions 
for  (XINTjYINT).  One  of  these  will  correspond  to  the  situation  where  the  sub¬ 
marine  waits  for  the  destroyer  to  approach,  and  then  heads  North  just  in  time 
to  achieve  a  CPA  of  RMINP.  By  leaving  earlier,  the  submarine  could  achieve 
a  larger  CPA. 

This  is  clearly  unrealistic,  when  the  submarine  is  opposing  a  single 
(detected)  destroyer.  In  other  words,  the  submarine  would  not  wait  the  indicated 
period,  but  would  go  North  immediately. 

However,  the  two  cases  have  been  includec.  to  allow  for  their  possible 
use  in  situations  where  (say)  the  submarine  is  attempting  to  penetrate  between 
two  destroyers.  No  use  has  been  made  of  this  in  the  current  work.  Instead,  a 
simpler  procedure  is  used  to  deal  with  two  or  more  destroyers,  as  follows. 

In  our  application,  if  both  solutions  are  feasible,  the  subroutine  would 
(already) have  indicated  a  wait  of  zero.  The  program  would  then  examine  any 
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other  detected  destroyers  to  see  if  a  wait  was  desirable  in  their  case.  The 
only  case  of  interest  to  us  is  where  only  one  of  the  solutions  is  feasible  ,  and 
the  program  determines  which  this  is.  For  completeness  ,  if  both  solutions 
are  feasible,  the  earlier  one  (i.e.  'he  one  with  the  earlier  time  corres¬ 
ponding  to  pQNT.YINT))  is  used.  A  tentative  decision  to  "go"  (proceed 
Northwards  immediately  is  made  if  at  least  one  of  the  following  holds; 

(i)  The  resulting  CPA  exceeds  RMINP 

(ii)  The  resulting  CPA  exceeds  GNGFAC  times  the  (best)  CPA  obtained 
by  waiting  for  a  favorable  opportunity  to  transit  (this  latter  CPA  will 
occur  during  the  WAIT  phase). 

The  motivation  for  this  is  that  a  resulting  CPA  no  worse  than  GNGFAC  of 
the  CPA  obtained  by  waiting  is  worth  risking,  because  of  assumed  time  con¬ 
straints  on  transit ,  and  increased  risk  of  detection  while  lying  off  the  barrier. 

In  the  event  that  a  tentative  decision  to  "go"  is  made  ,  we  examine  also 
what  will  happen  if  the  (best)  Wait  procedure  were  used.  If  the  resulting  CPA 
is  less  than  RDF  AC  of  P.MINP,  we  clearly  should  not  Wait  under  any  circumstances 
(for  example,  on  account  of  another  destroyer).  In  this  case,  AA  is  set  equal 
to  -1  as  a  flag,  and  further  examination  of  the  other  destroyers  is  abandoned. 

If,  on  the  other  hand,  there  is  no  such  urgency,  or  if  the  tentative 
decision  is  to  wait,  we  proceed  to  examine  the  other  detected  destroyers. 

If  no  urgent  "GO"  indication  is  found,  the  final  recommended  WAIT  period  is 
the  maximum  of  the  WAIT  periods  for  the  detected  destroyers. 
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Appendix  B-II.  Calculation  of  Detection  Probability 

(Describes  INTEG  Subroutine,  and  parts  of  GRIND  subroutine) 
We  assume  that  the  signal  excess,  in  db,  of  the  returned  ping  over 
background  noise  may  be  expressed  as 

E  =  Constant  -  40  logj^^r 


where  r  is  the  range  in  n.  mi. 

Let  us  incroduce  the  symbol  RMIN,  corresponding  to  the  range  at  which 
E  becomes  zero.  Then  it  is  convenient  to  define 


40  logjQ  (r/RMIN),  r<  RMIN 
0  .  r  >  RMIN 


The  probability  of  survival  for  a  given  submarine  transit,  writing  E,  r 
as  fvinctions  of  t,  will  be 


;^2 


(1)  exp  [-  J  X  E(t)  dt;]  =  exp  [-J  X40  log^Q  (t)  /RMIN)  dt] 


=  exp  [-20  (.  43429)  X  S 


^^2  2  2 
J  log  r  (t)  dt  -  (log^  RMIN  )  (t  -  t  ) 
tj  e  e  ^  1 


where  X  is  a  constant 

^1*^2  ^  ~  RMIN. 
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The  last  expression  (1)  is  calculated  in  the  subroutine  GRIND, 
using  13  different  values  for  X  . 

The  expression  (t^-tj^)  is  simply  the  accumulated  time  during  which 
the  range  is  less  than  RMIN,  and  this  is  accumulated  in  the  subroutine 
RANGE. 

The  expression 

f’  2 

J  log^  r  (t)  ♦  dt 

is  to  be  accumulated  only  during  the  same  period,  ensured  by  the  sub¬ 
routine  RANGE  again,  which  calls  the  subroutine  INTEG  for  the  com¬ 
putation  of  each  portion  of  the  integral.  It  is  convenient  to  calculate  the 
integral  for  intervals  of  time  during  which  the  motion  of  the  destroyer 
relative  to  the  submarine  is  straight  line. 


(TUPPj) 

(TLOW) 

DESTROYER 

(TUPP  2) 


DESTROYER 

(TUPP) 


Figure  B-9.  Straight  line  segments  of  relative  motion 
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Various  situations  can  arise,  and  the  "book-keeping"  is  handled  by  the  sub¬ 
routine  RANGE.  It  is  clear  that  INTEG  need  only  calculate  the  integral 
in  the  following  standard  situation. 

SUB.  CPA 


Fiqure  B-10.  Standard  Situation  for  INTEG 

2  2  2  2 
Now  r  =  a  +  b  t  ,  where  a  =  CPA  ,  b  =  v 

i  2  f  2 

Thus  J  log  (r  )  dt  =  J  log  (a  +  b  t  )  dt 
e  e 

=  t  log  (a  +  b  t^)  -  2t  +  2(a/b)^''^  tan'^[(b/a)^^^] 

This  expression  is  defined  in  INTEG  as  function  FN{T),  and  T  is  replaced 
by  TUPPand  TLOW  in  turn. 
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Appendix  B-III.  Contribution  of  Passive  Sensors  to 
Detection  Probability  (Subroutine  GRIND) 


Assume  that  the  distance  at  which  the  submarine  can  be  heard  by  a 
passive  detector  is  given  by 


R  = 


(.05U) 


The  average  duration  of  the  submarine's  transit  (time  counting  only 
while  the  submarine  is  in  motion)  is  called  (BB/FLII)  hours.  The  area  swept 
out  by  a  circle  radius  R  with  center  the  submarine,  ignoring  overlapping  sec¬ 
tion  s  ,  is  given  by 

2  T  (BB/FLII)  U 

where  U  =  speed  of  the  submarine  (knots). 

Assume  there  are  n  sensors  located  randomly  in  an  area 

4  .  (BARDEP  +  RMIN)  •  (BARWID  +  GAP) 


Figure  B- 1 1.  Region  containing  1  active,  n  passive,  sensors 


no 


^  j ! 

i  :  U 


Then  the  probability  of  no  detection  by  passive  sensors  is  given  by 


[exp  {-2  R  (BB/FLII)  u/aREA} 


This  expression  is  computed  for  various  values  of  n,  which  is  the 
ratio  of  passive,  active  sensors  (assume  each  destroyer  is  an  active  sensor). 
These  survival  probabilities  are  applied  ’n  turn  to  the  survival  probability 
relating  to  detection  by  active  sensors. 

It  is  assumed  that  no  interference  is  caused  to  passive  detection  by 
active  detection  procedures. 
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C.  THE  BARRIER  PENETRATION  PROBLEM 

1.  General  Discussion 

The  timing  of  an  attempted  penetration  through  a  screen  or 
barrier  is  an  important  tactic  for  a  submarine.  The  exposure  risk 
in  waiting  makes  an  early  penetration  desirable  while  the  additional 
information  and  possibly  more  favorable  positioning  available  by 
delaying  makes  a  later  penetration  desirable.  In  addition,  there  will 
generally  be  greater  utility  in  penetrating  during  some  periods  than 
during  others. 

When  destroyers  comprise  the  screen,  they  will  generally 
employ  active  sonar.  This  allows  the  submarine  to  acquire  informa¬ 
tion  about  the  probability  of  detection  for  the  various  courses  of  action 
available  to  it.  Furthermore,  this  information  is  constantly  being 
revised  until  the  submarine  dives  and  actxially  begins  the  transit.  In 
this  case,  the  submarine  is  faced  with  the  decision  of  when  to  stop 
waiting  and  to  initiate  an  action  v/hich  we  will  regard  here  as  irre¬ 
versible.  A  problem  of  this  sort  is  called  a  stopping  rule  problem 
although  in  our  case  it  might  have  been  more  appropriate  if  it  were 
termed  a  "starting"  rule  problem.  An  analysis  of  the  submarine 
penetration  problem  where  it  is  constantly  receiving  information 
from  active  sonar  destroyers  is  contained  in  the  next  section. 

In  some  instances,  the  submarine  cannot  regularly  obtain  new 
data  about  the  screen.  This  can  arise  from  such  factors  as  silent 
defenders  (destroyers,  submarine,  aircraft),  inability  to  hear  through 
self-noise,  and  separations  beyond  the  range  at  which  the  submarine 


can  hear  any  sonar.  To  model  this  situation  we  have  assumed  that 
the  submarine  may  make  an  initial  projection  of  the  probable  future 
location  of  defensive  craft  (using  a  uniform  distribution  if  no  informa¬ 
tion  at  all  is  available).  Since  no  additional  information  is  received 
the  optimal  waiting  period  and  subsequent  movement  through  the  screen 
can  be  determined  in  advance.  In  the  third  section  we  present  a  model 
of  this  situation  which  uses  a  discrete  control  theory  approach  and 
which  can  be  solved  by  dynamic  programming. 

It  is  our  feeling  that  these  models  are  fairly  realistic  represen¬ 
tations  of  present  submarine  performance  and  are  suitable  for  use  in 
models  of  submarine-barrit;r  as  screen  encounters.  However,  there 
are  situations  where  submarine  strategy  could  probably  be  improved 
by  application  of  these  methods.  This  is  particularly  true  of  the  first 
model  described  below. 


2.  Stopping  Rule  Analysis  of  the  Barrier  Penetration  Problem 


a.  Introduction 

We  assume  that  a  submarine  is  attempting  to  penetrate,  with¬ 
out  being  detected,  barrier  or  screen  patrolled  by  one  or  more  des¬ 
troyers.  Since  the  destroyers  employ  active  sonar  equipment,  the 
submarine  is  able  to  detect  the  presence  of  the  destroyers  before  the 
destroyers  are  able  to  detect  the  submarine.  The  problem  faced  by 
the  submarine  is  whether  to  continue  across  the  barrier  or  whether 
to  wait  for  more  fortuitous  positions  of  the  destroyers  along  the 
barrier.  If  it  waits  for  the  period,  the  submarine  may  reposition  it¬ 
self  to  be  better  situated  at  the  next  period  or  to  avoid  a  potential  threat 
during  the  current  period.  In  this  report  we  formulate  the  barrier 
penetration  problem  as  a  stopping  rule  problem  for  the  finite  horizon 
case  and  develop  the  dynamic  programming  recursion  which  computes 
the  optimal  policy  for  the  submarine.  We  then  extend  these  results 
to  allow  an  infinite  planning  horizon. 

b.  Definitions 

Let  tj ,  t2,  .  .  .  ,  t^,  . . .  be  a  set  of  times  such  that  either; 

(a)  The  submarine  first  detects  one  or  more  destroyers  at  t.; 

(b)  The  submarine  detects  one  or  more  destroyer  course  changes 

at  t.;  or 
1 

(c)  The  sub  narine  no  longer  detects  one  or  more  destroyers 
after  t^. 
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Let  P  (t^)  be  the  probability  that  the  submai’int:  will  be  detected 
after  t-  if  it  leaves  at  its  best  time  within  the  interval  Ft.,  t.  ,  ,)  and 
with  its  best  course. 

Let  A  (tj^)  be  the  probability  that  the  submarine  will  be  detected 
during  the  interval  [t^,  ^  2^  i^^itis^te  transit. 

We  assume  that  the  destroyers  employ  random  search  strategies 
(e.  g. ,  the  destroyers  follow  straight  line  trajectories  for  random  lengths 
of  time,  followed  by  random  course  changes).  Consequently,  P  (t.)  and 
Q  (L)  are  random  variables  for  i  “  1,  2,  ...  However,  at  L,  we 
assume  that  the  submarine  is  able  to  make  reasonable  estimates  for 
P  (L)  and  Q  (tj^)  and,  on  the  basis  of  these  estimates,  determine  whether 
to  continue  across  the  barrier  during  [L*  ^2^-2^°^  whether  to  wait  for 
the  entire  interval.  We  assume  that  the  random  variables  (P(L),  Q  (t.)) 
and  (PFL),  Q(tj))  are  statistically  independent  if  i  j,  but  we  do  allow 
P  (L)  and  Q  (t^^)  to  have  a  joint  density  function.  Let  f  [PFL),  Q  (L)] 
be  the  joint  probability  density  function  for  the  random  variables  for 
1  "  1,  2,.., 

Let  p.  ( •  )  be  a  Borel  measurable  policy  defined  as  follows:  if 

p.  [P(t.),  Q(t.)]  =  1 

then  the  submarine  leaves  on  its  best  course  and  at  its  best  time  during 

the  interval  Ft.,  t.  ,  and  if 
1  1+1 

-1.. 

■■ 

The  class  of  Borel  measurable  functions  is  defined  in  standard 
texts  such  as  Refs.  1  and  2. 
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p.  IP  (t.),  Q  (t.)]  =  0. 

then  the  submarine  waits  at  least  until  ^  j.  The  policy  (’  ), 
i  =  1,  2,  .  . . ,  defines  the  submarine  strategy  to  be  used.  In  the 
next  two  sections  we  will  characterize  the  form  of  the  optimal  sub¬ 
marine  policy. 

It  is  convenient  to  define  the  functions 

H  [p.  (. )]  =  [J p.  (P,  Q)  .  P.  f  (P.  Q)  dPdQ 


and 


G[Pj(-), 

=  J|[1  -  Pj(P,  •  (1-Q)+QI  t(P,QldPdQ. 


c.  Finite  Horizon  Case 

In  the  finite  horizon  case,  the  submarine  must  start  crossing 
the  barrier  within  the  inteval  [tj,  t^,).  The  function  [P  (t^),  Q(t^)] 
is  said  to  be  an  admissible  stopping  rule  policy  if: 

(a)  Pj^  [P(t.),  Q(t^)]  is  a  Borel  measurable  function  of  P(t^)  and 
Q(t.); 

(b)  p.  [P(t.),  Q(t.)]  €  {  0,  1  }  for  0  <  P(t.)  <  1  and  0  <  Q(t.)  <  1; 

(c)  if  i  =  T  -  1,  then 

pJP(t.).  Q(t.)]=  1  (1) 


and 
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The  last  condition  insures  that  the  submarine  will  start  crossing  the 
barrier  within  the  time  interval  [t^,  t^  ),  The  submarine  strategy 
over  the  entire  planning  horizon  is  defined  by  the  functions 

(•  )>  p2  (’  )i  '  •  •  P-p  2  convenient  to  use  the  convention  that 

(*  )  “  [Pj  (*  )»  ^2-1-2  »  ^T-1 

The  function  p.  (.  )  is  aid  to  be  admissible  if  and  only  if  the  functions 
Pi(‘),  P^  4.  2  (*)>•••«  P-p  j(* )  are  admissible  policies. 

Let  R2  t^i  expected  probability  of  detection  of  the 

submarine  after  t.,  given  that  the  submarine  waiting  during  [tj,  t. ) 
and  the  admissible  policy  P  (• )  is  used.  Here  R.  [P  .  (•  )j  is  a  complex 
function  of  P^  (*  )  H-)- 

-*•  :dc 

If  there  exists  a  policy  {•)  such  that 

—  — * 

for  all  admissible  policies  p  (.)-  then  o  (•)  is  said  to  be  the  optimal 

1  i  - 

th  —  * 

1  stage  stopping  rule  policy.  We  will  prove  that  {•)  exists  for 

i  =  1  ,2,  .  .  .  ,T-1  and  that  it  satisfies 

Pj  (')  =  [pi  (•)*Pj+2(*)l 

u.> 

*r» 

for  some  function  p  (•). 

i 
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tn 

THEOREM  1:  The  optimal  i  stage  stopping  rule  policy  {•)  exists 


and  is  defined  as 


*  # 


Pj  (•)  =  [p.  {•). p. •)....  ,p^_j('}] 


for  i  =  1  , .  .  .  ,T-1  ,  where 


p.  [P(t.).Q(t.)]  = 


1  if  P(t.)<  RT.,[i -OltjJrQ.'t.) 

1  —  l-rl  1  1. 


0  otherwise, 


R.  =  R[/3-r(-)]  , 

X  1 


and  R.  satisfies  the  recursion 
1 


R*=  H[p*(-)]  +  G[pJ.)>Rj^J 


for  i  =  1 , . .  .  ,T-1 ,  subject  to  the  terminal  condition 


❖ 

1 

T 
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PROOF :  This  result  is  proved  by  induction.  Consider  first  i  =  T-1. 
ByEqn.  1,  ^{•)  exists  and  is  defined  as 

P*_l[P(t^_l).Q(t.^_l)]  =  1 

for  all  and  Q(t^_j).  Since  =  1  ,  it  is  easy  co  verify  that 

p^_,(*),  R^  and  R^  do  satisfy  Eqns .  (3)- (5). 

Next  assume  that  the  theorem  is  true  for  i+1  ,i+2  ,  .  .  .  ,T-1  ,  and 

we  will  prove  the  result  for  i.  It  follows  froiTx  the  definitions  of  R  fp  (•)], 

i  ^i 

H[p^(  • )] ,  ^[p^' • )  .R^^j[p. (•)]]  and  the  independence  of  the  random  variables 

(P(t. )  ,Q(i. ))  and  (Pft  ),Q(t  ))  that  R.[p.(*)]  satisfies  the  recursion 

1  1  i+I  1+1  1  ^1 

RitPjl-)]  =  +  GlPi(-).Kj^,[Pi+l(-)n  (7) 

for  any  admissible  policy  p^(*)  =  [p.( * )  ip^^^  { • )]  .  By  the  definition  of 

G  and  the  induction  assumption. 


R,[p  (-)]  >  H[p.(.)]  +  G[p.(.),R*^J  . 
*  1  1  1  1+1 


(8) 


By  the  definitions  of  H[p.(-)]  and  Grp(*)-R 

1  i  ■  i+1 
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H[p.(-)]t  G[p.{.),R.'  ,] 
1  1  1+1 


(9) 


=  JJ  M[P,Q,R^^j,p.(.)]  f(P,Q)  dP  dQ  , 


where 


M[P.Q.R.^^  .p.{-)]  = 


for  p.  (P,Q)  =  1 


. 

I  Q  +  pAP.Qi  =  o 


If  we  define 


p.  (P,Q)  = 


1  for  P<  Q  +  R.,  •  (1-Q) 

—  1  +  1 

0  otherwise , 


(10) 


men 


l^[P,Q,Rr^,  .pJ^j  .p>)]  <  m[P,q,r*^^  ,pj.)] 


for  any  values  of  P.Q.andR,^,  and  for  any  admissible  function  p.(*). 
After  integrating  the  above  inequality,  we  have 


JJm[P,Q,R."^^,P>)]  f(P,Q)  dP  dQ 
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<  JJ  M[P,Q.R*^j.p.(.)]f(P.Q)  dP  dQ  , 


which  along  with  Eqns .  (8)-(9)  implies  that 


R.[p.f-)1  >  Hfo*! -ll  Gfo^f-KR*  1  . 

1  i  '  -  i  ■  •  i+i' 


(11) 


If  we  define 


P*{')  =  [p*(*),p_  j(-)] 


» 


then  by  Ecn.  (?) 


R  [p*(.)]  -  H[p*{.)]  +  G[p*(.),R*  J 

1  1  1  1  ITi 


(12) 


Thus  by  Eqns  .  (li)-(12), 

'r 

r..[F.  (•)]  <  r.  [p.  (•)] 

for  all  admissible  policies  (•  ).  Eqn  (10)  implies  Eqn.  (3),  and  Eqn. 
(12)  implies  Eqns.  (4)-(5),  which  completes  the  proof  of  the  theorem. 
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d.  Infinite  Horizon  Case 

In  this  section,  we  extend  the  results  of  the  previous  section 
to  allow  an  infinite  planning  horizon.  This  is  appropriate  when  there 
is  no  required  time  for  initiating  a  penetration  attempt  and  the  risk 
in  waiting  is  the  compelling  factor  for  an  early  transit.  Let  R  .  (t)  be 
the  minimum  probability  of  detection  of  the  submarine  after  t.,  given 
that  the  submarine  waited  during  [tj ,  L )  and  that  the  submarine  must 
start  crossing  the  barrier  within  the  interval  [t.,  t^  . 

THEOREM  2;  For  any  fixed  i,  the  limit 

r’^  =  lim  R*  (T)  (13) 

T — ' 

exists. 

PROOF;  It  is  a  simple  exercise  to  show  that 

R*  (T  +  1)  <Ri  (T). 

Since  R.  (T)  is  a  probability,  the  sequence  {R.  (i),  rT  (i  +  1), . . .  } 
is  bounded  from  below  by  zero.  Thus  the  theorem  follows  immediately 
from  the  Monontone  Convergence  Theorem  (Theorem  12.  1  in  Ref.  3). 

We  next  characterize  the  form  of  the  limit  R  .  If  X  is  a  ran¬ 
dom  variable,  then  we  represent  the  expectation  of  X  as  E  {XJ. 
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THEOREM  3:  R  satisfies 

(14)  E{min[P(t.);Q{t.)3}  <  R**' <  E{F(t.)3 

\  1  —  —  1 

for  i  =  1,2,... 

PROOF:  By  Eqn.  (10), 

M[P,Q,r!‘'  (T).p*‘(.)]--=min[P;QrR*  ,(T)  •  (1  -Q)] 

iTi  X  ITI 

which  is  a  continuous  function  of  P,Q,  and  R.  ,,{T).  Thus  it  follows  from 

1+1 

Theorem  23.9  in  Ref.  3  that 

JJmin[P;Q  +  R'‘^^j(T)  •  (1  -  Q)]  f  .P  ,Q)  dP  dQ 
♦ 

is  a  conlinuous  function  of  By  Theorem  2  and  an  elementary 

property  of  continuous  functions  (Theorem  15.2  in  Ref.  3), 


lim 

T-w 


n  f> 

i  min[P;Q 

J 


+  l^^j(T)-  (i -Q)]  f(P.Q)  dP  dQ 


min  (P;  Q  +  R 


* 


(i -Q)]  f(P.  Q)  dP  dQ  . 
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B>'Eqns.  (9)  and  (12), 


lim  r!'(T) 

T-«e3  ^ 


=  lim 
T-oo 


JJmin[P;Q  +  R*^^(T) 


(1-Q)]  f(P.Q; 


which  implies  that 


* 

R 


rjmin[P;  Q  +  R 


(1-Q)]  f(P,Q^  dPdQ 


Since 


min  [P;  Q  +  R  (1 


Q)]  <  P  , 


r’’  <  jj  P  f(P,Q)  dPdQ  =  ElP} 


V. Ijicii  is  the  right  hand  side  of  Eqn.  (14).  Also, 


min[P;  QtR' 


(I -Q)l  >  min[P:Q]  , 


and  thus 


# 

S  > 


V  V 


f  {P,Q)  dP  dQ  = 


E[min[P;  Q]] 
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dP  dQ 


which  is  the  left  hand  side  of  Eqn.  (14)  and  completes  the  proof  of  the 
theorem. 

For  density  functions  f[P{t.),  Q{t^)]  that  are  encountered  in 
practice,  it  is  expected  that 

E  (PCtj)}  <1 


and  that 


E  [min  [P(t^)]  }  >0; 

thus  Theorem  3  implies  that  the  limit  R  will  be  nontrivial 
(i.  e.  0  <R*  <1). 

to.  Conclusions 

Theorems  1-2  imply  that  the  optimal  stopping  rule  policy  p.  {• ) 
for  an  infinite  planning  horizon  is  in  the  following  form: 

fl  if  P(t.)<R*  .  [1  -Q(t)]  +  Q(t.) 
p":  [P  (t  ).  Q  (t  )]  "  (15) 

1^0  clherwise 

*r 

where  R  is  a  constant.  A  method  to  determine  R  is  the  following: 

use  simulatiovi  experiments  to  compute  the  submarine  detection  prob¬ 
er 

ability  for  several  values  of  R  ,  and  then  pick  that  value  which  results 
in  the  minimum  detection  probability. 
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Some  comments  on  the  use  of  the  policy  arising  from  Eqn,  (15) 
are  as  follows : 

(a)  Although  the  destroyers  may  make  random  course  changes 

as  the  times  L,  etc.,  the  random  variables  [P(t.),  Q(L)]  and 

[P(tj),  Q(tj)],  i  probably  will  not  be  stochastically  independent, 

particulaily  if  there  are  several  destroyers, 

T* 

(b)  There  may  be  different  values  of  R  for  different  positions 

of  the  submarine  in  the  barrier;  thus  the  empirical  procedure  for 

* 

measuring  R  described  above  results,  in  some  sense,  in  an  average 

* 

value  for  R  . 

(c)  Since  the  destroyers  use  random  search  tactics,  estimating 

P(t.)  and  Q(tj)  may  be  quite  difficult  in  practice.  One  approach  is  to 
assume  that  the  submarine  can  start  across  the  barrier  only  at  times 
ti»  etc. ,  and  then  estimate  P(t^)  and  Q{t^)  by  assuming  that  the 

destroyers  and  the  submarine  travel  indefinitely  on  straight  line 
trajectories. 

(d)  The  appropriate  value  for  R^  depends  upon  the  submarine's 
speed,  the  search  tactics  of  the  destroyers,  and  the  dimensions  of  the 
barrier.  After  determining  R  for  a  number  of  combinations  of 
different  values  for  these  parameters,  it  may  be  possible  to  develop 

a  functional  relationship  between  R  and  these  variables. 
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3.  Dynamic  Programming  Approach  to  the 
to  the  Barrier  Penetration  Problem 

a.  Introduction 

This  model  arises  when  a  submarine  attempts  to  penetrate  a 
finite  barrier  that  is  patrolled  by  one  or  more  vessels  and  v/hen  the 
following  assumptions  are  valid: 

1.  The  submarine  is  able  to  estimate  a  probability 
density  function  for  the  locations  of  the  vessels  patrolling 
the  barrier; 

2.  The  probability  that  the  submarine  can  be  de¬ 
tected  is  a  function  of  only  the  coordinates  of  the  sonar 
sensor  and  the  submarine  (i.  e.  ,  it  is  not  a  function  of 
their  velocities);  and 

3.  The  submarine  is  not  allowed  to  bypass  the 
barrier,  but  must  attempt  to  penetrate  it  within  T  time 
periods. 

The  probability  density  function  described  in  one  may  be 
simply  a  uniform  distribution  if  no  information  is  available.  We 
will  develop  a  dynamic  programming  algorithm  which  computes 
the  submarine  trajectory  that  minimizes  the  expected  number  of 
detections  prior  to  penetration. 

b.  Model  Formulation 

The  geometry  of  the  model  is  illustrated  in  the  following 
figure; 
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X 


The  finite  barrier  is  between  (0,0)  and  (0,  Y);  the  coordinates 
of  the  submarine  are  (x,  y);  and  the  coordinates  for  Destroyer 
are  (0,y.).  Define: 

T  =  the  maximum  number  of  time  periods  available 
for  the  submarine  to  penetrate  the  barrier, 

P.(y.,t)  =  the  probability  density  function  for  destroyer  D. 

^  ^  to  be  at  location  (0,  y^)  in  time  period  t, 

q(x,  y,  y.)  =  the  probability  that  a  destroyer  located  at  (0,  y.) 
will  detect  the  submarine  located  at  (x,  y) 
during  a  time  period, 

i  =  the  total  number  of  destroyers  that  are  patrolling 
the  barrier. 

Estimates  for  the  above  parameters  and  functions  are  assumed  to 
be  known  by  the  submarine. 


< 


We  will  iise  difference  equations  to  describe  the  motion  of  the 
submarine.  Let 

(x(t),  y(t))  =  the  coordinates  of  the  submarine  at  the  beginning  of 
the  t^h  time  period. 

(u(t),  v(t))  =  the  control  variables  affecting  the  submarine’s  tra¬ 
jectory. 

The  difference  equations  relating  the  trajectory  to  the  control  variables 
are 


x(t+l)  =  x(t)  +  A  u{t) 

y(t+l)  =  y(t)  +  B  v(t) 

The  control  variables  satisfy  the  constraints 

u(t)  €  (  U,  U+1  ,...,  -1,  0,+l,  .  . .  ,  U  } 
v(t)  t  {  y,  y+1  ...,  -1,0, +1 . V  } 

and 

u(t)^  +  v(t;^  y 

The  initial  coordinates  of  the  submarine  are 

x(0)  =  x^  and  y(0)  =  y^ 


(2) 

(3; 
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We  assume  that  A,  B,  U,  U,  V,  V,  x^,  and  are  integers  and 
that  (x^/A)  is  also  an  integer. 

s  s 

An  admissible  trajectory  X(x  ,y  ,  s,  T)  is  defined  to  be  a 
set  of  coordinates 

X(x®,  y^,  s,  T)  =  {  (x(t),  Y{t)):  t  =  s,  s+1, . .  . ,  t] 
which  satsify  Eqns.  (l)-(3),  the  coordinates 

x(s)  =  x^  and  y(s)  =  y®  ,  (5) 


the  constraints 


0  <  y(t)  <  Y  for  t  =  s,  s+1,...,  T  (6) 

and  the  terminal  condition 


x(T)  =  0. 


Define 


h[x,y,  t] 


_  Y 

-  n  J  30  (yi't)dyi;  n) 

1  =  1 


then  the  expected  number  of  detections  of  the  submarine  when 

5  S 

following  the  admissible  trajectory  X(x  »y  ,s,T)  is 
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(8) 


C[X(x^y^s.7)] 


E 

t=s 


h[x(t),  y(t),  t] 


Let 

F  =  the  set  of  admissible  trajectories  X(x^,y^,  0,  T)  such 
that  T<  T; 

*  0  0  * 

then  an  admissible  trajectory  X  (x  ,  y  ,  0,  T  )  is  said  to  be  optimal 
if 

C[X^'(x^,y  ,0.7^15  C[X(x°,y°,  0,T)] 
for  all  X(x*^,  y^,  0,  T)  C  F. 


c.  Dynamic  Programming  Algorithm 

We  now  develop  an  algorithm  based  upon  dynamic  programming 

which  computes  the  optimal  admissible  trajectory.  Let 
s  s 

f(x  ,  y  ,  s,  T)  =  the  minimum  expected  number  of  detections  of  a 
submarine  travelling  on  an  admissible  trajectory 
s  s 

from  (x  ,  y  )  at  time  period  s  to  the  barrier  at 
time  period  T. 

This  function  satisfies  the  recursion 


f(x®,  y®,  s,  r)  =  h(x®,y®,  s)  =h{x®,y®,s)  (9) 

+  min  C  f(x^  +  A  u(s),  y®  +  B  v{s),  s+1 ,  T)}, 

where  the  minimization  is  over  the  set  of  values  {u{s),  v(s))  satisfying 
constraints  (2) -(3).  By  definition 
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(10) 


f(0.  y’’.  T,  T  )  =  0  . 

Thus  by  using  Eqns.  (9)-(10),  f(x®,y®,s,T)  can  be  computed  for  all 

values  (x^,y®,  s)  for  which  there  exits  an  admissible  trajectory 

X(x®,y°,0,  T)  such  that  x(s)  =  x®  and  y(s)  =  y®  ,  The  trajectory 
^  s  s 

X  (x  ,y  ,s,T)  satisfying 

y^,  s,  T  )  =  C[X*  (x®,  y®,  s,  T)] 

is  also  determined  from  these  computations.  And  finally,  the 

4:  0  0  * 

optimal  admissible  trajectory  X  (x  ,y  ,  0,  T  )  is  found  by  solving 
the  minimization  problem: 

C[X*(x°,y°,0.T*)]  =  min  {C[X*(x®,  y°,  0,  T  )]:  T<T} 
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4.  Theoretical  Analysis  of  Threshold  Levels 

a.  Introduction 

In  section  Z  we  developed  the  stopping  rule  for  use  by  a  sub¬ 
marine  which  continually  receives  new  information  while  it  is  wait 
ing.  As  expressed  in  equation  15  for  an  infinite  time  horizon,  the 
submarine  should  stop  waiting  and  begin  the  transit  if  and  only  if 

p(t.)  <  R*  •  [l  -  Q(t.)  ]+  Q(ti).  (1) 

The  quantity  p(t^)  is  the  current  estimate  of  the  probability  of 
detection  i.f  the  submarine  begins  the  transit  in  time  t^  and  Q(t.)  is 
the  current  estimate  of  the  probability  of  detection  between  t.  and 
t. ,  ,  if  the  submarine  waits. 

The  value  of  R'  is  to  be  determined  as  a  function  of  the  geometry 
of  the  barrier,  the  speed  of  vessels,  the  destroyer  search  tactics, 
etc.  It  is  possible  to  determine  R  by  simulation  as  suggested  in 
section  2;  however,  it  is  our  objective  in  this  section  to  explore 
theoretical  procedures  for  obtaining  this  quantity. 

b.  Analysis 

It  will  be  convenient  to  introduce  some  new  notation  as  follows, 
x^  =  the  probability  of  a  successful  penetration  if  transit 
is  begun  in  period  t..  (This  equals  1  -  P(t.)  in 
section  2.  ) 

q  =  the  probability  that  the  submarine  will  survive 

between  any  two  successive  periods  if  transit  is  not 
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begun.  (This  equals  1  -  Q(t^)  where  Q(L)  is  indepen¬ 
dent  of  t..  ) 

1 

p  =  the  threshold  for  initiating  a  transit. 

The  value  of  p  is  related  to  R  .  By  substituting  in  equation  (1) 
above  we  find  that  transit  should  be  initiated  if  and  only  if: 

1  -  X.  <  R*  q+  (1-q)  (2) 

or 

X.  2q  -  R"q  =  q(l-R")  (3) 

•Ju 

Thus  the  threshold  is  related  to  R^  by  the  equality: 

p=q(l-R'^)  (4) 

In  this  section  we  will  work  with  p  instead  of  R^. 

The  value  of  x.  obtained  at  each  period  h  may  be  regarded  as 
being  drawn  from  some  (unknown)  distribution  F(x).  At  period  t.  we 
have  a  history  of  x/s  obtained  from  the  distribution.  We  shall  assume 
that  the  differences  At.  =  t^  -  t._j  are  sufficiently  large  so  that  the 
x^  are  statistically  independent;  we  also  may  regard  the  At.  as  fixed 
at  some  At  to  conform  to  our  definition  of  q  as  a  constant.  From 
the  x^  so  obtained,  we  can  determine  a  sample  mean  and  variance  at 
time  i.  Thus  we  define: 


X. 

1 


X.I/  i 

Jj- 


(5) 
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s. 

1 


1 

2 


(6) 


(x.  -  x.)/(i  ..  1) 


With  this  information  we  can  estimate  F(x)  at  time  t.;  we  will  call 

this  distribution  F.(x). 

1 

Since  x^  must  lie  in  the  range  [0,1],  the  distributions  must 
satisfy: 


F(0)  ^  0  F.(0)  =  0  (7a,  7b) 

F(l)  =  1  F.(l)  ^  1  {8a,  8b) 


It  will  be  convenient  in  the  following  tex>  to  use  the  distribution  com¬ 
plements  defined  by: 


F{x)  =  1 

-  F(x) 

(9) 

i\(x)=  1 

-  F.(x) 

(iC) 

Finally  let  us  assume  that  the  distributions  are  continuous  and  possess 
derivatives  given  by  f{x)  and  f.(x),  the  latter  being  associated  with 
the  F.  (x). 

At  period  t.  we  can  form  the  current  best  estimate  of  p  which 
we  will  call  r^.  It  will  be  a  function  of  F^{x)  and  consequently  a 
function  of  x.  and  s.. 

1  i 

We  can  also  define  the  current  estimate  of  the  expected  prob¬ 
ability  of  success  V-  as  follows: 


-  93  - 


The  first  part  of  the  expression  is  the  probability  of  a  successful 
transit  if  one  is  undertaken  and  the  second  part  is  the  probability 
of  waiting  until  period  t.^j^  times  the  probability  of  remaining 
undetected  during  times  the  probability  of  success  in 

period  t^^j^  .  The  true  value  of  the  expected  probability  of  suc¬ 
cess  V  can  be  defined  as  follows: 


V 


X  d  F(x) 


+ 


F(p)  q  V. 


(12) 


The  first  parts  of  equations  (11)  and  (12)  may  be  reform¬ 
ulated  by  integrating  by  parts.  Thus  we  obtain: 


(13) 


and  a  similar  exoression  with  r^  replaced  by  p.  Substituting 
(13)  into  (11)  we  obtain: 


V. 

1 


«1 


r.  F(r/)  +  J  F(x)  dx  +  q  F(r.) 


r. 

1 


(14) 


It  is  our  objective  to  determine  the  value  of  r^  which  maximizes 
this  expression. 

Compare  equation  (14)  with  the  expression  of  the  value  of  the 
game  if  p  were  known: 


P 
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■Jr-rryi  li 


Foi’ming  the  difference  of  v^  -  V  we  obtain: 

V.  -  V  =  r  F(r)  -  pF(p)  -  J  F(x)  dx  +  q  (v.^^  F{r)  -  v  F(p))  (l6) 

where  the  integral  J  F(x)  dx  is  to  be  treated  as  -J  F(x)  dx 

p  r  _ 

if  r  is  less  than  p.  Now  this  integral  can  be  approximated  as 

follows: 

j'^FCx)  dx  *1  F{p)  (r-p)  -  I  f  (p)  (r.p)^  .  (17) 

P 

Note  also  that  r  F{r)  -  P  F(p)  may  be  replaced  by: 

r  F(r)  -  r  F(p)  +  r  F(p)  -  pF(p)  (18) 

and,  upon  reax'ranging  and  using  F(x)  =  1  -  F(x),  by: 

-r  (F(r)  -  F(p))  +  (r  -  p))  +  (r  -  p)  F(p).  (19) 

Similarly  we  can  replace  q  (v£^_j  F(r)  -  v  F(p))  by: 

q  (F(r)  -  F(p))  +  q  F(p)  (v.^^  -  v).  (20) 

Substituting  these  expressions  into  equation  (16)  and  cancel¬ 
ling  terms  we  obtain: 

V.  -  V  (q  -r)  (F(r)  -  F(p))  +  |f  (p)  (r  -  P  )^  +  q  F(P)  (v.^j  -  v)  (21) 
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Transferring  the  right  most  part  to  the  left  hand  side,  multiplying 
by  g  and  replacing  F(r)  -  F(p)  by  the  approximation; 

f(p)  (r  -  p)  (22) 


we  obtain: 


q  (v.  -  v)  - 


q  r(p)  (v.^j  -  V)  ciq  (q  -  r)  f(p)  (r  -  p)+  |q  f(p){v-  pV  (23) 


This  can  be  simplified  to; 

q  (v.  -  v)  -  q^  F(p)  (v.^^  -  v)  ~  -  I  q  f(p){r  -  p)  [  (r  -  p )  +  2  (p -  q  v.^^)]  (24) 


Now  suppose  we  substitute  the  estimates  Fj(x)  and  f.(x)  for 

the  functions  F(x)  and  F(x).  We  can  then  solve  numerically  the 

following  equation,  derived  from  (15)  for  an  estimate  of  p  which 

we  will  call  p.: 

1 

Max  V  =  |p.  F^(pj)  +  J  F.  (x)  dxj  f  |l  -  q  F.  (p.)j 

where,  of  course,  .p.  is  between  zero  and  one.  The  estimate  p. 

1  1 

will  have  a  sampling  distribution. 

The  value  of  r^  is  set  relative  to  p.;  let  us  define; 


(25) 


r,  =  p.  +  m. 

11  1 

where  m.  will  be  determined  below.  There  will  be  a  derivative 


(26) 
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sampling  error  in  r..  Let  us  observe  that: 

Z{r.)  =  q  (27) 

where  I^(*)  denotes  expected  value  and 

p  =  q  V.  (28) 

These  are  necessary  conditions  for  the  threshold  and  estimated 

threshold  to  be  in  equilibrium.  The  conditions  mean  that  one  is 

indifferent  to  whether  he  waits  or  transits  when  the  stopping  rule 

is  just  satisified  as  an  equality. 

Let  us  define  a  new  variable  called  d.  as  follows 

1 

df  -  q(v^  -  v)  =  S(rj_j)  -  P  (29) 

Now  the  value  i;(r.  will  approach  p  as  i  increases  and  d. 
will  consequently  approach  0.  In  terms  of  d.,  equation  (24) 
becomes 

d.  -  q  F(p)  d.^^  ci  -  i  q  f(p)  [(r  -  p)^  -  2  (r  -  p)  (30) 

If  now  take  expectation  'with  regard  to  r  on  the  right 
side  of  this  equation  we  find 

d.  -  q  F(p)  d.^j  ~  -  7  q  f(P)  +  a.  ^  -  2  m.  (31) 

2 

where  O.  is  the  samoline  of  r..  Since  we  wish  to  maximize 
1  ‘  1 

2 

V.  and,  consequently,  d.  ,  we  will  maximize  2  m.  d. .  ,  -  m.  by 
1  1  11+ li-' 

setting  m^  =  K  we  assume  that  r  is  normally  distributed. 
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then  the  correct  choice  for  the  bias  for  r  is  thus 


2 

r  distributed  as  N  (p  +  o  )  (32) 

In  passing,  note  that 

=  V  +  -I  f(p)  (d.^  j  -  C.^)  +  qF(p)  d.^j  (33) 

or 

Vi=v+^f(p)  r(q  -  p)^  -  a.^]  +  qf(p  )  (qv.^j  -  p)  (34) 
c.  Application 

It  is  assumed  that,  in  practice,  the  following  conditions  are 
likely  to  obtain; 

(1)  Some  information  will  be  available  on  F('»).  The  form  of 
the  distribution  could  be  known,  and  there  may  be  a  priori  distributions 
on  the  parameters. 

Also,  some  information  on  the  -  in  particular  the  statistics 
X.  and  s.  -  may  have  alreadv  been  accumulated. 

The  "estimated"  form  of  F(*)  at  the  current  stage  of  the  game 
will  be  denoted  by  F^(*  )  ("b"  for  Bayesian). 

We  shall  be  looking  ahead  at  the  next  n  stages  of  the  game. 

F^(*  )  will  be  used  in  place  of  F(»  )  for  this  purpose,  in  computing 
optimal  strategy.  This  notation  is  distinct  from  the  notation  F^(  •  ) 
which  referred  to  the  current  best  estimate  of  F(  •  )  in  the  stage-by- 
stage  analysis  of  the  game. 

(2)  We  are  content  to  "look  ahead"  a  finite  number  of  stages, 

th 

n  say,  and  to  assume  that  at  the  n*"  stage  we  have 
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-  p  =  0  .  (35) 


^  ==d,,=qv,, 

n+ 1  n+ 1  n  n+ 1  ^  n+ 1 

(3)  The  variance  of  the  estimate  p  at  stage  n,  a^,  can  be 
estimated  in  advance.  This  estimate  may  be  derived  from  previous 
experience:  from  sampling  studies  making  use  of  F^{* );  or  from  other 
sources.  We  take 


n+1 


=  0  . 


(36) 


The  procedure  is  then  as  follows.  We  shall  determine  strategy 
for  the  current  stage  (Stage  1)  by  looking  ahead  n  stages.  This 
strategy  may  then  be  updated,  or  recalculated,  when  the  next  value 
of  X,  namely  is  determined,  provided  that  we  have  survived  to 
Stage  2. 

We  first  calculate  estimates  for  p,  v  from  equation  (25)  as: 


A 

V 


=  sup 
P 


pF^(p)  + 


Fb(r) 


d 

n 


1  -  qF^(p) 


where  the  supremum  is  attained  for 


(37) 


P  =  P.  (38) 

We  now  apply  equation  (34)  to  stage  n,  and  work  backwards 
until  we  reach  Stage  1.  Fj^(  •  ;  is  used  for  F(*  ),  etc.  ,  and  p  is  used 
for  p  . 


-  99  - 


References 


d. 


Chow,  Y.  S.  and  Robbins,  H.  E.  (1963)  "On  the  Values  associated 
stochastic  sequence,  "  Proc.  Fifth  Berkeley  Symp.  Math.  Stat. 
Prob. 

Gilbert,  John  P.  ,  and  Mosteller,  F.  ,  March  (1966)  "Recognizing 
the  Maximum  of  a  Sequence,  "  J.  A.  S.  A. 


-  101  - 


D.  INSTANTANEOUS  PROBABILITY  DETECTION 


1.  Introduction 

2.  The  X,  A,  a  Model 

3.  The  Instantaneous  Detection  Rate  Model 

4.  Fitting  the  Instantaneous  Detection  Rate  Model  to  Observe 
Data 

5.  Maximum  Likelihood  Estimators  and  Confidence  Regions 

6.  References 


Page 

103 

104 
107 

112 

113 

120 


-  102  - 


D.  INSTANTANEOUS  PROBABILITY  DETECTION 


1.  Introduction 

As  indicated  in  the  introductory  chapter,  a  satisfactory  model 
of  sonar  detection  1.'  an  essential  aspect  of  analyzing  submarine 
encounters  with  patrolling  vessels.  In  the  course  of  our  studies  we 
have  examined  several  approaches.  One  prevalent  method  is  referred 
to  as  the  "X,  CT,  model"  from  the  occurrence  of  three  parameters 
represented  by  these  three  Greek  .etters  in  the  equations  of  the  model. 
Because  of  its  popularity,  we  review  in  the  next  sections  that  model 
and  the  procedures  used  for  fitting  it  to  observed  data.  Another 
method  that  is  less  widely  used  is  the  instantaneous  detection  model. 

It  is  conjectured,  however,  that  this  model  better  explains  the  times 
to  detection  observed  in  actual  exercises.  In  section  3  we  will  describe 
the  instantaneous  detection  model  in  detail  and  in  section  4  we  will 
illustrate  the  procedures  for  fitting  the  model  to  observations  from 
exercises.  Finally,  in  section  5,  we  will  derive  maximum  likelihood 
estimators  and  confidence  regions  for  the  parameters. 
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2.  The  X ,  A>  g  Model 


We  will  first  describe  a  method  for  determining  detection 
probability  that  has  been  extensively  used.  Let  us  begin  by  assxuming 
the  geometry  and  other  parameters  (orientation,  depth,  speed,  etc.  ) 
of  the  submarine  transit  are  fixed.  For  example,  these  can  be  taken 
from  an  actual  exercise. 

In  Figure  D-1,  the  dotted  line  represents  the  expected  signal 
excess  of  the  returned  ping  from  the  submarine  over  the  background 
noise,  when  the  submarine  is  within  range.  However,  it  is  hypothesized 
for  this  model  that  the  actual  signal  excess  is  randomly  perturbed  from 
the  expected  signal  excess.  Such  perturbation  is  presumed  to  account 
for  the  observed  variations  in  detection  performance.  The  solid  line 
in  the  figure  depicts  a  possible  actual  signal  excess  distribution. 

This  method  models  the  variation  from  the  expected  signal  excess 
in  a  particular  manner.  Let  epochs  of  time  tj^,  t^,  ...  be  selected 
along  the  t  axis  by  drawing  from  an  exponential  distribution  with  para¬ 
meter  X  •  At  each  time  t^  the  difference  in  expected  and  actual  is 

presumed  to  change.  The  amount  of  the  nev/  difference  is  found  by 

2 

drawing  a  value  from  the  Normal  distribution  N(0,  cr  ).  This  value  is 
superimposed  (added  to)  the  theoretical  dotted  line  to  obtain  the  solid 
line.  Detection  is  then  said  to  occur  whenever  the  solid  line  crosses 
the  threshold  ^  and  the  result  of  the  model  is  a  binary  decision  as  to 
whether  detection  occurs.  To  obtain  the  probability  of  detection,  the 
whole  process  is  repeated  many  times  drawing  different  time  epochs, 
and  signal  jumps,  each  time.  The  resulting  number  of  detections,  divided 
by  sample  size,  yields  the  probability  of  detection. 
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We  can  now  vary  the  parameters  X  »  A>  and  a  and  obtain 
different  values  for  the  probability  of  detection. 

This  whole  process  is  repeated  for  a  group  of  attempted 
penetrations.  Various  tests  -  some  quite  complicated  -  have  been 
proposed  for  determining  the  set  of  parameter  (X,  A,o)  values 
which  provide  the  best  fit. 
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3.  The  Instantaneous  Detectioi.  ..ate  Model 


This  model  differs  in  one  important  aspect:  a  signal  excess 
over  the  threshold  A  does  not  imply  that  detection  occurs.  Rather 
the  significant  factor  is  the  time  that  each  positive  signal  excess 
persists.  This  is  accomplished  in  the  following  manner. 

As  shown  in  Figure  D-2,  we  again  start  with  a  "theoretical" 
predicted  signal  excess  curve,  shown  as  a  solid  line  in  the 
figure.  The  signal  excess,  over  a  stated  threshold,  is  indicated  by 
the  vertical  distance  E(t).  Since  a  positive  value  for  E{t)  no  longer 
implies  instant  detection,  we  calculate  an  instantaneous  probability 
of  detection  fvmction,  as  follows. 

Let  us  ass^ame  that  at  any  constant  level  of  E(t)  the  probability 
of  detection  is  the  same  in  any  interval  of  time  from  (t)  to  (t  +  At) 
for  small  At.  This  is  equivalent  to  assuming  that  the  detection  rate 
is  Poisson  distributed  with  a  parameter  X  called  the  instantaneous 
detection  rate.  The  probability  that  no  detections  occur  is 


In  the  more  general  case  that  X  is  a  function  of  time,  the  probability 
of  nu  detection  in  the  period  when  the  excess  is  positive  is: 


exp 


X(t)  dt]. 


The  signal  excess  E(t)  and  the  instantaneous  detection  rate 
X(t)  are  closely  related.  We  have  hypothesized  in  this  work  that  a 
quadratic  relationship  is  sxifficientiy  accurage.  /.  linear  relationship 
was  tried  in  Reference  1  and  did  not  appear  adeqimte. 


55^?!? 


Thus,  let  us  define  the  relationship: 


X(t)  =  A-E(t)  +  B-E'"(t) 


where  A  and  B  are  parameters.  In  figures  3  and  4  we  illustrate 
respectively  the  relation  of  X(fc)  to  E(t)  and  a  sample  X(t)  curve 

i. 

which  might  result  from  applying  the  X(t)  curB^in  figure  3  to  the 
E(t)  curve  in  figure  2.  y 

The  area  ^lnder  the  curve  in  Figure  4  is  J  ^  (t)dt.  This 

area  is  measured  in  decibel-minutes,  abbreviated  db.  -min. ,  and  the 
model  is  frequently  referred  to  as  the  db,,  -min.  model  (read  "dee- 
bee -minutes  model"). 

In  the  following  sections,  a  method  for  estimating  these  para¬ 
meters  is  given,  and  also  (specifically  for  the  linear  case  when 
B  =  0)  a  method  for  obtaining  confidence  intervals  for  these  para¬ 
meters  is  given. 

In  predicting  the  probability  of  detection  for  future  ASW  exer¬ 
cises,  these  confidence  intervals  are  used  as  follows.  They  provide, 
in  a  sense,  an  idea  of  the  "fuzziness"  associated  with  detection  model 
parameters.  The  size  of  the  intervals  can  be  used  to  directly  calc\ilate 
not  only  the  expected  number  of  detections  in  a  planned  group  of  exer¬ 
cises,  but  also  the  range  of  the  niimber  of  detections  (or,  a  lower  limit 
for  the  nximber),  that  would  be  reasonable  taking  into  account  the  diffi¬ 
culty  in  estimating  environmental  conditions,  temperature  gradients 
of  the  water,  etc. 

These  items  are  calculated  directly  rather  than  estimated 
by  means  of  repeated  Monte  Carlo  runs.  This  produces  a  more 
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Figure  D-3.  Relation  of  Instantaneous  Detection  Rate  to 

Signal  Excess 


Instanta  .leous 
Detection  Rate  X  (t) 


Figure  D-4.  Instantaneous  Detection  Rate  for  the  Instantaneous 

Detection  Rate  Model 
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reliable  and  easily  used  model. 

In  addition,  in  the  last  section,  there  will  be  found  methods 
for  testing  goodness  of  fit  of  the  models  proposed  here. 


F itting  the  Instantaneous  Detection  Rate  Model  to  Observed  Data 
A  certain  amount  of  data  has  been  collected  on  the  distribution 


of  time  to  first  detection  in  destroyer  vs.  submarine  games.  It  is 
conjectured  that  an  instantaneous  detection  rate  model  may  ade¬ 
quately  explain  the  variation  in  times  to  first  detection.  A  "brute - 
force"  maximum  likelihood  method  is  described  for  obtaining  estimates 
of  model  parameters,  and  joint  confidence  regions.  These  estimates 
would  be  used  in  estimating  probabilities  of  detection  in  barrier  (or 
convoy  screen)  models,  and  in  stating  such  probabilities  with  a 
required  degree  of  confidence. 

In  the  following  discussion  we  shall  let  S  represent  the  transiting 
submarine  and  D  the  destroyer  or  other  sonar  platform.  Let  us 
assume  that  we  have  the  following  data. 

(i)  The  positions  of  S  and  D  at  the  start  (beginning 
of  exercise) 

(ii)  The  courses  of  S  and  D  throughout  the  exercise 

(iii)  Time  of  first  (valid-  detection  of  S  by  D ,  if  any. 

K  contact  lost,  times  of  subsequent  re-detections. 

We  assxime  that,  conditional  on  no  detection  by  time  t,  the 
probability  of  detection  in  the  interval  (t,  t  -t  dt)  is  X{t)  dt  (the  usual 
instantaneous  rate  assumption).  In  fact,  following  the  usual  noise 
propagation  assumptions,  suppose  initially  that 

X  ~max[0,  {Lg(v)  -  Lp(u)  +  }  -  k  log  r  ] 

where 

Lj^(u)  =  "self-noise"  of  Destroyer  speed  u 


I 

r 

r 

r 

r 

r 

I 


( 


L„(v)  =  radiated  noise  of  Submarine  at  speed  v 
Njjj  =  directivity  factor 

=  "recognition  differential"  necessary  to  distinguish 

K.1J 

[with  probability  50% ]  the  Submarine  from  back¬ 
ground  noise.  [If  the  period  of  observation  is 
infinitely  long.  ] 

r  =  distance  between  S  and  D 

k  =  exponent  of  "noise  law"  (usually  taken  as  2) 

(Conversion  factors  for  db  and  log^  have  been  omitted.  ) 

We  may  conveniently  write 

X  ~  function  (v,  u,  DI,  RD)  -  k  log  r  (2) 

In  the  following  v  will  denote  the  velocity  of  S  relative  to  D. 


D  _<L 


/ 


A 


Figure  D-5.  Geometry  of  Approach  Path 


For  approximate  straight-line  motion  let  A  be  the  closest  point  of 
approach.  Then: 

2  2  .  2  .2 
r 

2  log  r 
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=  a  +  V  t 


1  /  2  ^  2  ^2, 
log  (a  +  V  t  ). 


! 


X  can  thus  be  expressed  directly  in  terms  of  time.  And,  in 
fact,  this  expression  (for  a  straight  line  segment  of  the  relative  course) 
can  be  integrated  exactly  over  time.  This  procedure  is  described  in 
detail  in  another  chapter  in  this  (Chapter  B). 

Thus,  provided  in  approximate  motion  on  straight  line  segments, 
we  obtain  an  exact  expression  for 


(4) 

(5) 
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5,  Maximum  Likelihood  Estimators  and  Confidence  Regions  for  (A,  B) 


Equation  (4),  or  (5),  with  t  =  t*,  represents  the  likelihood  that 
first  detection  occurs  at  t*  in  a  particular  trial.  The  likelihood  can 
be  Slimmed  over  t*'s,  taken  from  different  trials.  For  trials 
where  t  =  »  (no  detection  occurred)  the  expression 

exp  [  -J  X(t)  dt]. 

^1 

should  be  used. 

We  obtain  an  overall  likelihood  function 

L(A,  B;  t*)  =  P(t*  I  A,  B) .  (7) 

The  values  of  A  and  B  which  maximize  this  expression  can  be  found 
by  a  steepest  ascent  procedure.  Furthermore,  using  approximate 
methods,  we  can  determine  a  "confidence  region"  for  A,  B,  namely 
a  region 

^95%  ”  ^^1  —  —  ^2,  ’  ^1  — 

such  that  the  mass  of  the  likelihood  function  contained  in  Cncm 

7  0/0 

0.95.  These  confidence  bounds  on  A,  B  can  then  be  used  in  com¬ 
puting  the  overall  probability  of  detection  in  a  proposed  scenario, 
and  of  providing  a  lower  confidence  limit  on  the  number  of  detections 
out  of  100  trials  (say). 

The  foregoing  procedure  closely  follows  the  methodology  in  the 
reference  [3],  Singpurwalla.  The  fi-.ld  of  application  in  the  latter 
is  reliability  theory,  but  the  same  instantaneous  detection  rate  function 
applies,  and  the  application  is  very  similar. 
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Alternatively,  the  following  "standard"  procedure  may  be 
sufficiently  good,  provided  the  total  number  of  observatiois  is  suffi¬ 
ciently  large.  It  is  known  (Kendall,  p.  42)  that  maximum  likelihood 
estimators  are  asymptotically  efficient.  In  our  case  the  maximum 
likelihood  estimators  for  A  and  B  are  jointly  normally  distributed, 
asymptotically,  and  the  variances  and  covariance  can  be  obtained  by 
taking  the  2nd  derivative  of  the  log  likelihood  function.  This  can  cer¬ 
tainly  be  done  analytically  in  our  case,  although  the  computation  will 
be  somewhat  tedious. 

Thus  we  can  use  the  bivariate  Normal  distribution  and  use  stan¬ 
dard  tables  to  pick  out  our  95%  confidence  region  for  (A,  B). 

Even  better,  we  can  store  the  parameters  <.f  this  bivariate  dis¬ 
tribution.  Then,  in  any  concrete  situation,  such  as  determining  the 
probability  of  detection  when  a  submarine  attempts  to  penetrate  a 
patrol  barrier  using  some  stated  patrol  strategy,  we  can  proceed  as 
follows. 

We  compute  the  probability  of  detection  using  an  (approximate) 
analytical  formula,  and  assuming  A  and  B  known  exactly.  Then, 


introduce  the  joint  (asymptotic)  distribution  for  A  and  B,  and  integrate 
out  A  and  B.  This  will  be  the  maximum  likelihood  estimate  of  prob¬ 
ability  of  detection.  Next,  assuming  that  A  and  B  are  present  in  the 


probability  of  detection  formula  in  some  simple  analytical  form  such  as 
A/B  or  (A  +  B  )  ,  we  can  obtain  the  distribution  of  this  form  and 


obtain  confidence  limits  directly  on  the  probability  of  detection. 

The  question  arises  whether  the  quadratic  "failure -rate"  model 
for  X(t)  is  adequate  to  explain  observed  variations  in  first  detection  time. 


The  cumulative  distribution  function  of  t,  time  to  first  detection, 
is  given  by 


The  values  of  this  function  should,  if  our  model  is  correct,  be 
random  observations  from  the  rectangular  distribution  on  [O,  l].  The 
Kolmogoroff  test  can  be  used  to  verify  this. 

Hov/ever,  we  may  consider  our  model  "sufficiently  good"  if  any 
anomalies  from  this  rectangular  distribution  are  small,  and  no  significant 
improvement  can  be  made  on  the  fit  by  dividing  the  data  in  sub-classes 
(e.  g.  trials  with  a  sea- state  of  5  or  lower;  with  an  S-speed  of  5-7  knots; 
etc.  ). 

In  similar  situations,  Kolmogorov  tests  have  been  applied, 
but  heavy  use  has  been  made  of  Monte -Carlo  simulation  to  provide 
tests  of  significance.  These  tests,  and  significance  levels,  must  be 
calculated  anew  for  each  new  situation. 

In  contrast,  recent  work  by  Lilliefors  [2]  indicates  that  more 
general  significance  levels  can  be  obtained  in  conjxmction  with  the  Chi- 
squared  test.  His  paper  also  suggests  the  optimal  number  of  intervals 
to  use  (at  least  six). 

This  paper  does  not  deal  specifically  with  truncated  observations 
of  the  type  we  encounter,  but  the  following  obvious  modification  suggests 
itself. 
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CPD 


Figure  D-6a  Value  of  CPD  at  which  detection  occurs  (if  at  all) 

First,  all  the  predicted  cumulative  probability  of  detection  funcdons 
are  normalized,  as  shown  in  the  figure.  In  general,  Pr  (detection)  v/ili 
increase  up  to  an  asymptotic  value,  denoted  by  P^. 

The  observed  value  of  the  cumulative  probability  distribution 
(CPD)  at  which  detection  occurs  is  denoted  by  p.  If  no  detection  occurs, 
we  arbitrarily  draw  the  value  p  from  a  uniform  distribution  on  the 
interval  1  j„ 

Suppose  that  the  recommended  number  of  intervals  is  six.  The 
following  figure  illustrates  the  observed  p's,  in  histogram  form,  from 
a  series  of  runs  (n  in  number). 
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Frequency  of  observed  p 


Figure  D-7.  Hypothetical  Frequency  of  Observed  p. 

The  Chi-square  test  is  then  applied  in  the  usual  way,  making 
use  of  the  significance  levels  supplied  in  Lilliefors'  paper.  Note,  in 
that  paper,  that  appropriate  attention  is  paid  to  the  number  of  para¬ 
meters  of  the  "db-minutes"  model  which  are  estimated  from  the  data. 

As  far  as  is  known  (from  the  available  literature)  no  other 
goodness -of-fit  test  currently  in  use,  or  proposed,  for  detection 
models  has  this  feature.  In  view  of  the  small  sample  sizes  experienced, 
the  importance  of  this  feature  is  obvious. 
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E.  THE  DISTRIBUTION  OF  THE  TRANSIT  POINT 


IN  A  SUBMARINE  VS.  DESTROYER  GAME 


Preface 

This  chapter  contains  the  text  of  an  article  submitted  during  the 
project  to  the  Naval  Logistics  Research  Quarterly.  Since  no  decision 
has  been  reached  on  publishing  it,  it  is  included  here  in  its  entirety. 

The  subject  of  the  paper,  tne  distribution  of  a  submarine's  transit 
point,  arose  tangentially  to  the  general  r  tady  of  submarine-destroyer 
encounters.  He  represents  an  abstract  theoretical  analysis  of  the  pro¬ 
bability  distribution  of  the  location  of  the  midpoint  cf  the  larger  gap. 
hi  so  far  as  this  theoretical  distribution  approaches  the  actual  distri¬ 
bution  occurring  in  practice,  the  results  have  several  useful  applications. 
One  which  appears  to  require  some  attention  on  the  part  of  the  Navy  is 
to  use  sonobuoys  or  other  silent  sonar  systems  distributed  in  proportion 
to  the  gap  distribution.  The  objective  would  be  to  minimize  the  maxi¬ 
mum  probability  of  penetration  anywhere  along  a  screen  or  barrier. 

The  article  follows. 
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THE  DISTRIBUTION  OF  THE  TRANSIT  POINT  IN  A  SUBMARINE  I 

(1) 

VS.  DESTROYER  GAME,  SPLIT -THE -GAP  STRATEGY.'  ' 

Alan  J.  Truelove  ; 

MATHEMATIC  A,  Bethesda,  Md. 

4 


Abstract 

Destroyers  patrol  randomly  and  independently  along  three 
segments  of  a  straight-line  barrier.  A  submarine  takes  one, 
and  only  one,  look  at  their  positions,  and  picks  a  transit  point 
by  splitting  the  larger  gap.  What  is  the  probability  distribution 
of  this  point  ? 


1 ,  O'  Introduction 

Thyee  destroyers  patrol  a  line  (stationary,  in  the  barrier  case; 
advancing  with  constant  speed  in  the  convoy  escort  case}* 


_ |//////////////| _ 

-(6a+2b)  -(2a+2b) 


2  o 

j//////////////j _ - 

-2a  0  2a  2a+2b  6a+2b 


Fig.  1:  Patrol  Segments  ,  General  Case 


The  patrol  segments  are  specified  in  Fig.  1  and  are  supposed  of 
equal  length,  with  equal  gaps  between  adjacent  segments. 


Work  performed  under  Contract  N00014-70-C-0307,  Office  of 
Naval  Research,  The  author  acknowledges  helpful  discussions  with 
Mr  J,  Randolph  Simpson,  ONR,  and  Mr  Peter  Perkins,  TRW  Systems. 
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A  submarine  views  the  three  destroyers  instantaneously,  and  once 

only,  and  determines  their  positions  (but  not  their  directions  of  motion). 

» 

The  submarin  j  chooses  the  larger  of  the  two  gaps  and  takes  the  mid¬ 
point  M  of  the  gap  as  his  transit  point.  The  purpose  of  this  appendix  is 
to  determine  the  distribution  of  this  point  M.  The  simpler ,  two  Ctestroyer 
case  is  solved  also. 

1.1  Comments  on  possible  applications,  and  related  work 

(a)  The  theoretical  distributions  could  be  compared  with 
emr.irical  distributions  of  transit  points  (after  suitable  normalization, 
to  take  account  of  different  barrier  dimensions).  Unfortunately,  the 
latter  distributions  appear  in  classified  publications. 

(b)  Suppose  that  the  submarine  crosses  the  barrier  line  a  fixed 
time  T  after  it  takes  a  look  at  the  destroyers'  position.  This  'lag' 

T  could  be  assumed  sufficiently  large  so  that  the  destroyer  positions 
at  T  would  be  independently  distributed  of  their  positions  at  time  zero. 
Alternatively,  the  new  positions  could  be  assumed  correlated  with  the 
old  positions,  or  some  specific  patrol  pattern  could  be  simulated 
during  the  lag  T. 

The  probability  of  detection  (destroyer  on  submarine),  PD,  could 
then  be  calculated  using  cookie  -  cutter,  or  instantaneous  probability 
([2],  p.  506)  methods. 

(c)  In  a  game  theory  situation,  the  destroyers  could  attempt 
to  improve  PD  by  modifying  the  distribution  of  their  position  within 
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the  respective  segments.  Techniques  which  are  applicable  to  this  j 

problem  can  be  found  in  [l].  | 

On  the  other  side,  the  stibmarine  could  attempt  to.  lower  PD  j 

by  basing  his  choice  of  transit  point  on  the  specific  positions  of  all 
three  destroyers,  instead  of  just  splitting  the  larger  gap. 

(d)  We  could  elaborate  the  single -look  assumption,  by  allowing 
the  submarine  to  acquire  some  information  on  destroyer  positions  when 
(if  ever)  he  gets  close  enough  to  one  or  more  of  them,  and  allow  some 
modification  of  submarine  course  thereafter. 


2.0  Assumptions 

We  assume  the  destroyers  patrol  randomly  and  independently  m 

their  .egments,  and  in  such  a  way  thet(e.g.) destroyer  I's  position  at  an 

arbitrary  time  is  uniiormly  distributed  in  the  segment  (-(6a+2b),-(2a+2b)). 
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3 , 0  Mathematical  Statement  of  Problem 

X. ,  7=1 ,  3  are  independent  random  variables  uniformly  drawn  from 

the  ranges  shown  in  Fig.  1.' 

y  is  defined  as  the  mean  of  ..  if  ^3  "  ^2  —  ^2  ”  *1 
as  the  mean  of  x^  ,  x^ . 


4.0  Results 

4.1  Three  Destroyers 

The  p.d.f.  for  y,  g(y),  is  continuous: 


Range  for  y 
b ,  a+b 
a+b ,  2a+b 


(4.1) 


2a+b ,  3a+b 
^3a+b ,  4a+b 


p.d.f.,  g(yj 

(y-b)  [3a-(y-b)]  /  12a 

[(y-b)+a]  /  12a 

[7a-2(y-b)]  /  12a^ 

2  3 

[{y-b)-4a]  /  •i2a 


Also,  gvb)  =  g(4a+b)  =  0 
g(a+b)  =  l/6a 
g(2a+b)  =  1  /4a 
g(3a+b)  =  1  /12a 
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5.0  Analysis 

5.1  Three  Destroyers 

It  is  sufficient  to  consider  the  problem  with  "the  gaps  closed 
up."  A  simple  transformation,  y  (y“*o),  with  appropriate  changes  for 
the  range,  then  yields  the  result  in  Sec.  4. 


^1  -^2  y  ^3 

-6a  -2a  0  2a  6a 


Fig  .  4;  Simplified  Situation 


In  the  following  work,  assume  that  y  falls  in  the  right-hand  side  of 
the  figure  (i.e.  y  >  0) .  The  resulting  distribution  will  then  be  conditional 
on  this  event,  and,  using  symmetry,  we  can  easily  obtain  the  true  p.d.f . 
for  y . 

To  save  excessive  repetition  of  the  factor  (l/4a),  take  the  p.d.f  .'s 
for  the  as  1 ,  for  the  moment.  The  notation  (,)  is  to  be  taken  as 
referring  to  the  closed  interval. 

Fix  y  in  (0,4a). 

The 'Allowable  "  range  for  x  [i.e.  ,  that  for  which  there  exists  an 
x^  yielding  the  stated  y]  is  obtained  as  follows. 
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=  2y  -  x^,  €  (2a, 6a) 

i.e.  x^  g  (2y  -  6a ,  2y  -  2a).  ^Also,  of  course,  x^  C  (-2a,  2a). 

Now,  for  y  to  be  the  gap-split  point,  we  must  have 

Xj  >  X2  -  (2y  -  x^)  =  Sx^  -  2y  . 

Also,  x^  €  (-6a,  -2a). 

The  following  figure  indicates  the  "allowable"  range  for  x^  as  a 
function  of  x^ .  The  position  of  the  points  A,D  can  change  relative  to 
B  .C  .  depending  on  the  value  of  y  originally  fixed. 


-2a 

-6a 

2y  -  6a  (2/3)y-2a  (2/3)y  -  (2/3)a  2y  -  2a 

Fig.  5:  Allowable  Range  for  x 
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[We  have  made  use  of  the  following: 


{-6a  /  r(2./3)y-  2a 

implies  ^  < 

-2a  [(2/3)y-(2/3)a 


Still  keeping  y  fixed,  we  now  integrate  over  the  per'iitted  ranges 
(dependent  on  y).  Two  types  of  integral  arise,  as  shown: 

(2/3)  (y-3a) 

(i)  y  €  (2a, 3a):  [  4a  ♦  dx  =  (l6/3)a(3a-y) 

2(y-3a) 


y  €  (0,2a)  :  f 


(2/3)  (y-3a) 


1  4a  •  dx  =(8/3)  ay 

''  -2a  ^ 


.(2/3)(y-a)  . 

(ii)  y  c  (a, 3a)  :  (2y-3x  -2a)  dx  ={8/3)a 

(2/3)  (y-3a) 


2(y-a) 

yc(0,a):  (2y-3x  -2a)  dx  =(8/3)y(2a-y) 

(2/3)  (y-3a) 


„(2/3)(y-a)  ^ 

yc(3a,4a):  (2y-3x  -2a)  dx  =(8/3)(y-4a) 

2(y-3a) 

Performing  the  integration  over  y .  we  obtain 
(5.1)  a^  [8/3  +  16/3  +  16/3  +  16/9  +  8/9]  =  16a^  . 


y  y+dy 


x^  X2+2dy 


Fig.  6:  Allowable  Increment  for  x^ 
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Consideration  of  Fig.  6  shows  the  correct  p.d.f.  for  x  is  2/4a  =  (l/2a); 

5 

the  p.d.f.  for  x^  ,x^:  (l/4a).  We  thus  apply  a  factor  (l/2a)*  (l/4a)^=  (l/32a^) 
to  (5.1),  obtaining  1/2.  The  other  (1/2)  of  the  p.d.f.  for  y  occurs  for 
y  c  (-4a, 0). 

Combining  the  exprv^ssions  in  (i),(ii),  and  introducing  the  factor 

3 

(l/32a''  ),  we  obtain  the  result  in  Sec.  4. 

5.2  Two  Destroyers 

If  destroyers  2  and  3  only  are  involved,  the  corresponding 
integrals  are 

2a  <  y  <  4a:  1  •  dx  =  8a  -  2y 

2y  -  6a  ^ 

o  2y  -  2a 

®  1  y  1  2a  :  I  1  •  dx  =  2y 

-2a  ^ 

r-  2 

ihe  "correct"  factor  is  (l/8a  ),  by  an  argument  similar  to  that  in 
5.1,  and  we  obtain  the  re  suit  in  Sec .  4.2. 
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